Bayesian models of graphs, arrays and other exchangeable random structures

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 37, Issue 2, 2015, Pages 437-461

  Orbanz, Peter ^a   Roy, Daniel M ^b  

^a Och Spine at New York Presbyterian Hospitals   (United States)

^b UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

COLLABORATIVE FILTERING; GRAPH THEORY;

DIRICHLET PROCESS; GAUSSIAN PROCESS REGRESSION; MATHEMATICAL FOUNDATIONS; NON-PARAMETRIC BAYESIAN MODELING; NONPARAMETRIC BAYESIAN MODELS; PROBABILITY THEORY; RANDOM STRUCTURES; THEORETICAL FOUNDATIONS;

BAYESIAN NETWORKS;

EID: 84920964398     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2014.2334607     Document Type: Article

References (70)

1. E. M. Airoldi, D. M. Blei, S. E. Feinberg and E. P. Xing, "Mixedmembership stochastic blockmodels," J. Mach. Learn. Res., vol. 9, pp. 1981-2014, 2008.
2. D. Aldous and R. Lyons, "Processes on unimodular random networks," Electron. J. Probab., vol. 12, no. 54, pp. 1454-1508, 2007.
3. D. J. Aldous, "Representations for partially exchangeable arrays of random variables," J. Multivariate Anal., vol. 11, no. 4, pp. 581-598, 1981.
4. D. J. Aldous, "Exchangeability and related topics," in- Ecole d'- Et-e de Probabilit-es de Saint-Flour XIII-1983, P. L. Hennequin, Ed., New York, NY, USA: Springer, 1985, pp. 1-198.
5. D. J. Aldous, "Exchangeability and continuum limits of discrete random structures," in Proc. Int. Congress Math., 2010, vol. 1, pp. 141-153.
6. D. J. Aldous, "More uses of exchangeability: Representations of complex random structures," in Probability and Mathematical Genetics: Papers in Honour of Sir John Kingman, Cambridge, U.K.: Cambridge Univ. Press, 2010, pp. 35-63.
7. N. Alon and J. H. Spencer, The Probabilistic Method. New York, NY, USA: Wiley, 2008.
8. T. Austin, "On exchangeable random variables and the statistics of large graphs and hypergraphs," Probab. Surv., vol. 5, pp. 80- 145, 2008.
9. S. Bacallado, S. Favaro and L. Trippa, "Bayesian nonparametric analysis of reversible Markov chains," Ann. Statist., vol. 41, no. 2, pp. 870-896, 2013.
10. M. J. Beal, Z. Ghahramani and C. Rasmussen, "The infinite hidden Markov model," in Proc. Adv. Neural Inform. Process. Syst. 14, 2002, pp. 577-584.
11. I. Benjamini and O. Schramm, "Recurrence of distributional limits of finite planar graphs," Electron. J. Probab., vol. 6, no. 23, pp. 1-13, 2001.
12. J. Bertoin, Random Fragmentation and Coagulation Processes, Cambridge, U.K.: Cambridge Univ. Press, 2006.
13. P. J. Bickel, A. Chen, and E. Levina, "The method of moments and degree distributions for network models," Ann. Statist., vol. 39, no. 5, pp. 2280-2301, 2011.
14. Bollobás, B., S. Janson, and O. Riordan, "The phase transition in inhomogeneous random graphs," Random Struct. Alg., vol. 31, no. 1, pp. 3-122, 2007.
15. C. Borgs, J. Chayes, L. Lovász, V. T. S-os, B. Szegedy, and K. Vesztergombi, "Graph limits and parameter testing," in Proc. 38th Annu. ACM Symp. Theory Comput., 2006, pp. 261-270.
16. C. Borgs, J. Chayes, and L. Lovász, "Moments of two-variable functions and the uniqueness of graph limits," Geom. Func. Anal., vol. 19, no. 6, pp. 1597-1619, 2010.
17. T. Broderick, M. I. Jordan, and J. Pitman, "Cluster and feature modeling from combinatorial stochastic processes," Statist. Sci., vol. 28, no. 3, pp. 289-312, 2013.
18. T. Broderick, J. Pitman, and M. I. Jordan, "Feature allocations, probability functions and paintboxes," Bayesian Anal., vol. 8, no. 4, pp. 801-836, 2013.
19. H. Bühlmann, "Austauschbare Stochastische Variabeln und ihre Grenzwertsätze," Ph.D. thesis, ETH Zürich, Univ. California Press, Oakland, CA, USA, 1960.
20. P. Diaconis, "Sufficiency as statistical symmetry," in Proc. 100th Annu. Amer. Math. Soc., 1992, pp. 15-26.
21. P. Diaconis and D. Freedman, "De Finetti's theorem for Markov chains," Ann. Probab., vol. 8, no. 1, pp. 115-130, 1980.
22. P. Diaconis and S. Janson, "Graph limits and exchangeable random graphs," Rendiconti di Matematica, Serie VII, vol. 28, pp. 33- 61, 2008.
23. R. Durrett, Random Graph Dynamics. Cambridge, U.K.: Cambridge Univ. Press, 2006.
24. B. de Finetti, "Funzione caratteristica di un fenomeno aleatorio," Atti Reale Accademia Nazionale dei Lincei, vol. 6, no. 4, pp. 86-133, 1930.
25. B. de Finetti, "La pr-evision: Ses lois logiques, ses sources subjectives," Ann. Inst. H. Poincar-e, vol. 7, no. 1, pp. 1-68, 1937.
26. S. Fortini and S. Petrone, "Predictive construction of priors in Bayesian nonparametrics," Braz. J. Probab. Statist., vol. 26, no. 4, pp. 423-449, 2012.
27. D. A. Freedman, "Invariants under mixing which generalize de Finetti's theorem," Ann. Math. Statist., vol. 33, pp. 916-923, 1962.
28. D. A. Freedman, "Invariants under mixing which generalize de Finetti's theorem," Ann. Math. Statist., vol. 34, pp. 1194-1216, 1963.
29. A. Frieze and R. Kannan, "Quick approximation to matrices and applications," Combinatorica, vol. 19, no. 2, pp. 175-220, 1999.
30. T. L. Griffiths and Z. Ghahramani, "Infinite latent feature models and the Indian buffet process," in Proc. Adv. Neural Inf. Process. Syst. 18, 2006, pp. 475-482.
31. E. Hewitt and L. J. Savage, "Symmetric measures on Cartesian products," Trans. Amer. Math. Soc., vol. 80, no. 2, pp. 470-501, 1955.
32. N. Hjort, C. Holmes, P. Müller, and S. Walker, Eds,. Bayesian Nonparametrics. Cambridge, U.K.: Cambridge Univ. Press, 2010.
33. P. Hoff, "Modeling homophily and stochastic equivalence in symmetric relational data," in Proc. Adv. Neural Inf. Process. Syst. 19, 2008, pp. 657-664.
34. P. D. Hoff, "Separable covariance arrays via the Tucker product, with applications to multivariate relational data," Bayesian Anal., vol. 6, no. 2, pp. 179-196, 2011.
35. P. W. Holland, K. B. Laskey, and S. Leinhardt, "Stochastic blockmodels: First steps," Soc. Netw., vol. 5, no. 2, pp. 109-137, 1983.
36. D. N. Hoover, "Relations on probability spaces and arrays of random variables," Inst. Adv. Study, Princeton, NJ, USA, Tech. Rep., 1979.
37. O. Kallenberg, "Multivariate sampling and the estimation problem for exchangeable arrays," J. Theor. Probab., vol. 12, no. 3, pp. 859-883, 1999.
38. O. Kallenberg, Foundations of Modern Probability, 2nd ed. New York, NY, USA: Springer, 2001.
39. O. Kallenberg, Probabilistic Symmetries and Invariance Principles. New York, NY, USA: Springer, 2005.
40. C. Kemp, J. Tenenbaum, T. Griffiths, T. Yamada, and N. Ueda, "Learning systems of concepts with an infinite relational model," in Proc. Nat. Conf. Artif. Intell., 2006, vol. 21, pp. 381-389.
41. J. F. C. Kingman, "The representation of partition structures," J. London Math. Soc., vol. 2, no. 18, pp. 374-380, 1978.
42. J. F. C. Kingman, "On the reconciliation of probability assessments" J. Roy. Statist. Soc. Ser. A, vol. 142, no. 2, pp. 146-180, 1979.
43. U. Küchler and S. L. Lauritzen, "Exponential families, extreme point models and minimal space-time invariant functions for stochastic processes with stationary and independent increments," Scand. J. Statist., vol. 16, pp. 237-261, 1989.
44. S. L. Lauritzen, Extremal Families and Systems of Sufficient Statistics. New York, NY, USA: Springer, 1988.
45. J. R. Lloyd, P. Orbanz, D. M. Roy, and Z. Ghahramani, "Random function priors for exchangeable arrays," in Proc. Adv. Neural Inform. Process. Syst. 25, 2012, pp. 1007-1015.
46. L. Lovász, "Very large graphs," in Current Developments in Mathematics, D. Jerison, B. Mazur, T. Mrowka, W. Schmid, R. Stanley and S. T. Yau, Eds. Somerville, MA, USA: Int. Press, 2009, pp. 67-128.
47. L. Lovász," Large Networks and Graph Limits. Providence, RI, USA: Amer. Math. Soc., 2013.
48. L. Lovász and B. Szegedy, "Limits of dense graph sequences," J. Combinatorial Theory Ser. B, vol. 96, pp. 933-957, 2006.
49. L. Lovász and B. Szegedy, "Szemer-edi's lemma for the analyst," Geometric Funct. Anal., vol. 17, no. 1, pp. 252-270, 2007.
50. S. N. MacEachern, "Dependent Dirichlet processes," Ohio State Univ., Columbus, OH, USA, Tech. Rep., 2000.
51. K. T. Miller, T. L. Griffiths, and M. I. Jordan, "Nonparametric latent feature models for link prediction," in Proc. Adv. Neural Inform. Process. Syst. 20, 2009, pp. 1276-1284.
52. P. Orbanz and B. Szegedy, "Borel liftings of graph limits," http:// arxiv.org/abs/1312.7351v1, 2013.
53. J. Paisley, A. Zaas, C. Woods, G. Ginsburg, and L. Carin, "A stickbreaking construction of the beta process," in Proc. Int. Conf. Mach. Learn., 2010, pp. 847-854.
54. J. Paisley, D. Blei, and M. Jordan, "Stick-breaking beta processes and the Poisson process," in Proc. Int. Conf. Artif. Intell. Statist., 2012, pp. 850-858.
55. J. Pitman, Combinatorial Stochastic Processes. Berlin, Germany: Springer-Verlag, 2006.
56. C. E. Rasmussen and C. K. I. Williams, Gaussian Processes for Machine Learning. Cambridge, MA, USA: MIT Press, 2006.
57. D. M. Roy, "Computability, Inference and Modeling in Probabilistic Programming," Ph.D. thesis, Dept. Electr. Eng. Comput. Sci., Massachusetts Inst. Technol., Cambridge, MA, USA, 2011.
58. D. M. Roy and Y. W. Teh, "The Mondrian process," in Proc. Adv. Neural Inform. Process. Syst. 21, 2009, pp. 1377-1384.
59. M. J. Schervish, Theory of Statistics. New York, NY, USA: Springer, 1995.
60. J. Sethuraman, "A constructive definition of Dirichlet priors," Statist. Sinica, vol. 4, no. 2, pp. 639-650, 1994.
61. Y. W. Teh and M. I. Jordan, "Hierarchical Bayesian nonparametric models with applications," in Bayesian Nonparametrics, N. L. Hjort, C. Holmes, P. Müller and S. G. Walker, Eds. Cambridge, U.K.: Cambridge Univ. Press, 2010.
62. Y. W. Teh, D. Görür, and Z. Ghahramani, "Stick-breaking construction for the Indian buffet process," in Proc. 11th Conf. A.I. Statist., 2007, pp. 556-563.
63. Y. W. Teh, C. Blundell, and L. Elliott, "Modelling genetic variations using fragmentation-coagulation processes," in Proc. Adv. Neural Inf. Process. Syst. 24, 2011, pp. 819-827.
64. R. Thibaux and M. I. Jordan, "Hierarchical beta processes and the Indian buffet process," in Proc. 11th Conf. Artif. Intell. Statist., 2007, pp. 564-571.
65. V. S. Varadarajan, "Groups of automorphisms of Borel spaces," Trans. Amer. Math. Soc., vol. 109, no. 2, pp. 191-220, 1963, pp. 564- 571.
66. S. Wasserman and C. Anderson, "Stochastic a posteriori blockmodels: Construction and assessment," Soc. Netw., vol. 9, no. 1, pp. 1-36, 1987.
67. P. J. Wolfe and S. C. Olhede, "Nonparametric graphon estimation," http://arxiv.org/abs/1309.5936v1, 2013.
68. Z. Xu, V. Tresp, K. Yu, and H.-P. Kriegel, "Infinite hidden relational models," in Proc. 22nd Int. Conf. Uncertainty Artif. Intell., 2006, pp. 544-551.
69. Z. Xu, F. Yan, and Y. Qi, "Infinite tucker decomposition: Nonparametric Bayesian models for multiway data analysis," in Proc. 29th Int. Conf. Mach. Learn., 2012, pp. 1023-1030.
70. S. L. Zabell, "Characterizing Markov exchangeable sequences," J. Theor. Probab., vol. 8, no. 1, pp. 175-178, 1995.