Nonparametric Bayesian modeling of complex networks: An introduction

IEEE Signal Processing Magazine

Volumn 30, Issue 3, 2013, Pages 110-128

  Schmidt, Mikkel N ^a   Morup, Morten ^a  

^a TECHNICAL UNIVERSITY OF DENMARK   (Denmark)

Author keywords

[No Author keywords available]

Indexed keywords

BAYESIAN NETWORKS; KNOWLEDGE BASED SYSTEMS; MARKOV PROCESSES; MODEL STRUCTURES;

BAYESIAN NONPARAMETRICS; MARKOV CHAIN MONTE-CARLO; MODEL PARAMETERS; MODELING STRUCTURES; NON-PARAMETRIC BAYESIAN MODELING; NON-PARAMETRIC MODEL; PARAMETRIC MODELING; PREDICTIVE PERFORMANCE;

COMPLEX NETWORKS;

EID: 85032752062     PISSN: 10535888     EISSN: None     Source Type: Journal    
DOI: 10.1109/MSP.2012.2235191     Document Type: Review

References (59)

1. E. Airoldi, D. Blei, S. Fienberg, and E. Xing, "Mixed membership stochastic block models," J. Mach. Learning Res., vol. 9, pp. 1981-2014, Sept. 2008.
2. D. Aldous, "Exchangeability and related topics," in École d'Été de Probabilités de Saint-Flour XIII-1983 (Lecture Notes in Mathematics). Berlin, Germany: Springer, 1985, pp. 1-198.
3. K. Andersen, M. Mørup, H. Siebner, K. Madsen, and L. Hansen, "Identifying modular relations in complex brain networks," in Proc. IEEE Int. Workshop Mach. Learning Signal Process., 2012, pp. 1-6.
4. A. Barabasi and R. Albert, "Emergence of scaling in random networks," Science, vol. 286, no. 5439, pp. 509-512, Oct. 1999.
5. D. Blei and M. Jordan, "Variational inference for Dirichlet process mixtures," Bayesian Anal., vol. 1, no. 1, pp. 121-144, 2006.
6. K. Börner, S. Sanyal, and A. Vespignani, "Network science," Annu. Rev. Inform. Sci. Technol., vol. 41, no. 1, pp. 537-607, 2007.
7. A. Clauset, C. Moore, and M. Newman, "Hierarchical structure and the prediction of missing links in networks," Nature, vol. 453, no. 7191, pp. 98-101, 2008.
8. N. R. C. Committee on Network Science for Future Army Applications, Network Science. Washington, D.C.: The National Academies Press, 2005.
9. R. Cross and A. Parker, "Conducting and interpreting a social network analysis," in The Hidden Power of Social Networks. Boston, MA: Harvard Business School Press, 2004.
10. V. Eguiluz, D. Chialvo, G. Cecchi, M. Baliki, and A. Apkarian, "Scale-free brain functional networks," Phys Rev Lett., vol. 94, no. 1, pp. 1-4, 2005. (Pubitemid 40620264)
11. S. Fortunato, "Community detection in graphs," Phys. Rep., vol. 486, nos. 3-5, pp. 75-174, 2010.
12. O. Frank and D. Strauss, "Markov graphs," J. Amer. Statistic. Assoc., vol. 81, no. 395, pp. 832-842, Sept. 1986.
13. A. Gelman, J. Carlin, H. Stern, and D. Rubin, "Background," in Bayesian Data Analysis. Chapman & Hall/CRC Press, 2004.
14. S. Gershman and D. Blei, "A tutorial on Bayesian nonparametric models," J. Math. Psychol., vol. 56, no. 1, pp. 1-12, 2012.
15. P. Green and S. Richardson, "Modelling heterogeneity with and without the Dirichlet process," Scandinavian J. Statistics, vol. 28, no. 2, pp. 355-375, 2001.
16. T. Griffiths and Z. Ghahramani, "Infinite latent feature models and the Indian buffet process," in Proc. Advances Neural Inform. Processing Syst., 2006, pp. 475-482.
17. T. Griffiths and Z. Ghahramani, "The Indian buffet process: An introduction and review," J. Mach. Learning Res., vol. 12, pp. 1185-1224, Apr. 2011.
18. T. Herlau, M. Mørup, M. Schmidt, and L. Hansen, "Modelling dense relational data," in Proc. IEEE Int. Workshop Mach. Learning Signal Processing, Santander, Spain, 2012, pp 1-6.
19. T. Herlau, M. Mørup, M. Schmidt, and L. Hansen, "Detecting hierarchical structure in networks," in Proc. Cognitive Inform. Processing, Baiona, Spain, 2012, pp. 1-6.
20. P. Hoff, "Multiplicative latent factor models for description and prediction of social networks," Comput. Math. Organization Theory, vol. 15, no. 4, pp. 261-272, 2009.
21. J. Hofman and C. Wiggins, "Bayesian approach to network modularity," Phys. Re v. Lett., vol. 100, no. 25, pp. 1-4, June 2008.
22. K. Ishiguro, T. Iwata, N. Ueda, and J. Tenenbaum, "Dynamic infinite relational model for time-varying relational data analysis," in Proc. Advances Neural Inform. Processing Syst., 2010, pp. 919-927.
23. K. Ishiguro, N. Ueda, and H. Sawada, "Subset infinite relational models," in Proc. Int. Conf. Artif. Intell. Statistics, (J. Machine Learning Res. Workshop and Conf. Proc.) vol. 22, 2012, pp. 547-555.
24. S. Jain and R. Neal, "A split-merge Markov chain Monte Carlo procedure for the Dirichlet process mixture model," J. Comput. Graph. Statistics, vol. 13, no. 1, pp. 158-182, 2004. (Pubitemid 38422439)
25. B. Karrer and M. Newman, "Stochastic block models and community structure in networks," Phys. Rev. E, vol. 83, no. 1, pp. 1-10, 2011.
26. C. Kemp, J. Tenenbaum, T. Griffiths, T. Yamada, and N. Ueda, "Learning systems of concepts with an infinite relational model," in Proc. National Conf. Artif. Intell., Menlo Park, CA, vol. 21, 2006, p. 381.
27. D. Knowles and Z. Ghahramani, "Infinite sparse factor analysis and infinite independent components analysis," in Proc. Independent Compon. Anal. Signal Separation, 2007, pp. 381-388.
28. P. Krivitsky and M. Handcock, "Fitting latent cluster models for networks with latent net," J. Statistical Software, vol. 24, no. 5, pp. 1-23, 2008.
29. M. Kuhn, M. Campillos, I. Letunic, L. Jensen, and P. Bork, "A side effect resource to capture phenotypic effects of drugs," Molecular Syst. Biol., vol. 6, no. 1, pp. 1-6, 2010.
30. J. Leskovec, "Dynamics of large networks," Ph.D. dissertation, Carnegie Mellon Univ., Sept. 2008.
31. P. McCullagh, J. Pitman, and M. Winkel, "Gibbs fragmentation trees," Bernoulli, vol. 14, no. 4, pp. 988-1002, 2008.
32. E. Meeds, Z. Ghahramani, S. Neal, and R. M. Roweis, "Modeling dyadic data with binary latent factors," in Proc. Advances Neural Inform. Processing Syst., 2007, pp. 977-984.
33. D. Meunier, R. Lambiotte, and E. Bullmore. (2010). Modular and hierarchically modular organization of brain networks. Frontiers Neurosci. [Online]. 4(Dec.). Available: http://dx.doi.org/10.3389/fnins.2010.00200
34. K. Miller, T. Griffiths, and M. Jordan, "Nonparametric latent feature models for link prediction," in Proc. Advances Neural Inform. Processing Syst., 2009, pp. 1276-1284.
35. M. Morris, M. Handcock, and D. Hunter. (2008). Specification of exponential-family random graph models: Terms and computational aspects. J. Statistical Software [Onli ne]. 24(4), 1-24. Available: http://www.jstatsoft. org/v24/i04
36. M. Mørup and M. Schmidt, "Bayesian community detection," Neural Comput., vol. 24, no. 9, pp. 2434-2456, 2012.
37. M. Mørup, M. Schmidt, and L. Hansen, "Infinite multiple membership relational modeling for complex networks," in Proc. NIPS Workshop Networks Across Disciplines Theory and Appl., Whistler, BC, Canada, 2010, pp. 1-8.
38. M. Mørup, M. Schmidt, and L. Hansen, "Infinite multiple membership relational modeling for complex networks," in Proc. IEEE Int. Workshop Mach. Learning Signal Processing, Beijing, China, 2011, pp. 1-6.
39. P. Mucha, T. Richardson, K. Macon, M. Porter, and J. Onnela, "Community structure in time-dependent, multiscale, and multiplex networks," Science, vol. 328, no. 5980, pp. 876-878, 2010.
40. R. Neal, "Bayesian mixture modeling," in Proc. 11th Int. Workshop Maximum Entropy and Bayesian Methods Statistical Anal., 1992, pp. 197-211.
41. M. Newman, "Modularity and community structure in networks," Proc. Natl. Acad. Sci., vol. 103, no. 23, pp. 8577-8582, 2006. (Pubitemid 43878062)
42. K. Nowicki and T. Snijders, "Estimation and prediction for stochastic block structures," J. Amer. Statistical Assoc., vol. 96, no. 455, pp. 1077-1087, 2001.
43. K. Palla, D. Knowles, and Z. Ghahramani, "An infinite latent attribute model for network data," in Proc. Int. Conf. Mach. Learning, 2012, pp. 1-8.
44. E. Ravasz, A. Somera, D. Mongru, Z. Oltvai, and A. Barabási, "Hierarchical organization of modularity in metabolic networks," Science, vol. 297, no. 5586, pp. 1551-1555, 2002.
45. G. Robins, P. Pattison, Y. Kalish, and D. Lusher, "An introduction to exponential random graph (p*) models for social networks," Social Networks, vol. 29, no. 2, pp. 173-191, 2007.
46. G. Robins, T. Snijders, P. Wang, M. Handcock, and P. Pattison, "Recent developments in exponential random graph (p*) models for social networks," Social Networks, vol. 29, no. 2, pp. 192-215, 2007.
47. D. Roy, C. Kemp, V. Mansinghka, and J. Tenenbaum, "Learning annotated hierarchies from relational data," in Proc. Advances Neural Inform. Processing Syst., 2007, p. 1185.
48. D. Roy and Y. Teh, "The mondrian process," in Proc. Advances Neural Inform. Processing Syst., Vancouver, BC, Canada, 2009, pp. 1377-1384.
49. M. Rubinov and O. Sporns, "Complex network measures of brain connectivity: Uses and interpretations," NeuroImage, vol. 52, no. 3, pp. 1059-1069, 2010.
50. M. Sales-Pardo, R. Guimera, A. Moreira, and L. Amaral, "Extracting the hierarchical organization of complex systems," Proc. Natl. Acad. Sci., vol. 104, no. 39, p. 15224, 2007.
51. P. Sarkar, D. Chakrabarti, and M. Jordan, "Nonparametric link prediction in dynamic networks," in Proc. ICML, Edinburgh, Scotland, 2012, pp. 1-8.
52. M. Schmidt, T. Herlau, and M. Mørup, "Nonparametric Bayesian models of hierarchical structure in complex networks," Informatics and Mathematical Modelling, Technical Univ. Denmark (DTU ) Tech. Rep., Sept. 2012.
53. H. Simon, "The architecture of complexity," Proc. Amer. Philos. Soc., vol. 106, no. 6, pp. 467-482, 1962.
54. O. Sporns, "Introduction: Why networks," in Networks of the Brain. Cambridge, MA: MIT Press, 2010.
55. U. von Luxburg, "A tutorial on spectral clustering," Statistics Comput., vol. 17, no. 4, pp. 395-416, 2007.
56. S. Wasserman and G. Robins, "An introduction to random graphs, dependence graphs, and p*," in Models and Methods in Social Network Analysis. Cambridge, U.K.: Cambridge Univ. Press, 2005, pp. 148-161.
57. D. Watts and S. Strogatz, "Collective dynamics of 'small-world' networks," Nature, vol. 393, no. 6684, pp. 440-442, June 1998.
58. Z. Xu, V. Tresp, K. Yu, and H. Kriegel, "Infinite hidden relational models," in Proc. Uncertainty Artif. Intell., 2006, pp. 1-8.
59. W. Zachary, "An information flow model for conflict and fission in small groups," J. Anthropological Res., vol. 33, no. 4, pp. 452-473, 1977.