Estimating network degree distributions under sampling: An inverse problem, with applications to monitoring social media networks

Annals of Applied Statistics

Volumn 9, Issue 1, 2015, Pages 166-199

  Zhang, Yaonan ^a   Kolaczyk, Eric D ^a   Spencer, Bruce D ^b  

^a USA   (United States)

^b NORTHWESTERN UNIVERSITY   (United States)

Author keywords

Constrained penalized weighted least squares; Degree distribution; Inverse problem; Network; Network sampling

Indexed keywords

EID: 84929675276     PISSN: 19326157     EISSN: 19417330     Source Type: Journal    
DOI: 10.1214/14-AOAS800     Document Type: Article

References (51)

1. ACHLIOPTAS, D., CLAUSET, A., KEMPE, D. and MOORE, C. (2005). On the bias of traceroute sampling or, power-law degree distributions in regular graphs. In STOC’05: Proceedings of the 37th Annual ACM Symposium on Theory of Computing694–703. ACM, New York. MR2181674.
2. AHMED, N., NEVILLE, J. and KOMPELLA, R. R. (2011). Network sampling via edge-based node selection with graph induction. CSD TR # 11-016 1–10. Purdue Univ., West Lafayette, IN.
3. AHMED, N. K., NEVILLE, J. and KOMPELLA, R. R. (2012). Network sampling designs for relational classification. In ICWSM.
4. AHMED, N. K., BERCHMANS, F., NEVILLE, J. and KOMPELLA, R. (2010). Time-based sampling of social network activity graphs. In Proceedings of the Eighth Workshop on Mining and Learning with Graphs 1–9. ACM, New York.
5. AHN, Y.-Y., HAN, S., KWAK, H., MOON, S. and JEONG, H. (2007). Analysis of topological characteristics of huge online social networking services. In Proceedings of the 16th International Conference on World Wide Web835–844. ACM, New York.
6. BAILEY, N. T. et al. (1975). The Mathematical Theory of Infectious Diseases and Its Applications. Charles Griffin & Company Ltd., London.
7. BOYD, S. and VANDENBERGHE, L. (2004). Convex Optimization. Cambridge Univ. Press, Cambridge. MR2061575.
8. COCHRAN, W. G. (1977). Sampling Techniques, 3rd ed. Wiley, New York. MR0474575.
9. CVX RESEARCH, INC. (2012). CVX: Matlab software for disciplined convex programming, version 2.0 beta. Available at: http://cvxr.com/cvx.
10. DALEY, D. J. and GANI, J. M. (1999). Epidemic Modelling: An Introduction. Cambridge Univ. Press, Cambridge.
11. DONG, J. and SIMONOFF, J. S. (1994). The construction and properties of boundary kernels for smoothing sparse multinomials. J. Comput. Graph. Statist. 3 57–66.
12. ELDAR, Y. C. (2009). Generalized SURE for exponential families: Applications to regularization. IEEE Trans. Signal Process. 57 471–481 MR2603376.
13. FRANK, O. (1971). Statistical inference in graphs. Ph.D. thesis, Foa Repro Stockholm.
14. FRANK, O. (1980). Estimation of the number of vertices of different degrees in a graph. J. Statist. Plann. Inference4 45–50 MR0587030.
15. FRANK, O. (1981). A survey of statistical methods for graph analysis. Sociol. Method. 12 110–155.
16. FRANK, O. (2005). Network sampling and model fitting. In Models and Methods in Social Network Analysis 31–56. Cambridge Univ. Press, Cambridge.
17. GJOKA, M., KURANT, M., BUTTS, C. T. and MARKOPOULOU, A. (2010). Walking in Facebook: A case study of unbiased sampling of OSNs. In INFOCOM, 2010. Proceedings IEEE1–9. IEEE, New York.
18. GJOKA, M., BUTTS, C. T., KURANT, M. and MARKOPOULOU, A. (2011). Multigraph sampling of online social networks. IEEE J. Sel. Areas Commun. 29 1893–1905.
19. HALL, P. and TITTERINGTON, D. M. (1987). On smoothing sparse multinomial data. Aust. J. Stat. 29 19–37 MR0899373.
20. HANDCOCK, M. S. and GILE, K. J. (2010). Modeling social networks from sampled data. Ann. Appl. Stat. 4 5–25 MR2758082.
21. HUBLER, C., KRIEGEL, H.-P., BORGWARDT, K. and GHAHRAMANI, Z. (2008). Metropolis algorithms for representative subgraph sampling. In Data Mining, 2008. ICDM’08. Eighth IEEE International Conference on283–292. IEEE, New York.
22. JIN, L., CHEN, Y., HUI, P., DING, C., WANG, T., VASILAKOS, A. V., DENG, B. and LI, X. (2011). Albatross sampling: Robust and effective hybrid vertex sampling for social graphs. In Proceedings of the 3rd ACM International Workshop on MobiArch11–16. ACM, New York.
23. KEPHART, J. O. and WHITE, S. R. (1991). Directed-graph epidemiological models of computer viruses. In Research in Security and Privacy, 1991. Proceedings, 1991, IEEE Computer Society Symposium on343–359. IEEE, New York.
24. KOLACZYK, E. D. (2009). Statistical Analysis of Network Data: Methods and Models. Springer, New York. MR2724362.
25. KURANT, M., MARKOPOULOU, A. and THIRAN, P. (2011). Towards unbiased BFS sampling. IEEE J. Sel. Areas Commun. 29 1799–1809.
26. KURANT, M., GJOKA, M., BUTTS, C. T. and MARKOPOULOU, A. (2011). Walking on a graph with a magnifying glass: Stratified sampling via weighted random walks. In Proceedings of the ACM SIGMETRICS Joint International Conference on Measurement and Modeling of Computer Systems 281–292. ACM, New York.
27. KURANT, M., GJOKA, M., WANG, Y., ALMQUIST, Z.W., BUTTS, C. T. and MARKOPOULOU, A. (2012). Coarse-grained topology estimation via graph sampling. In Proceedings of the 2012, ACM Workshop on Workshop on Online Social Networks25–30. ACM, New York.
28. LAKHINA, A., BYERS, J. W., CROVELLA, M. and XIE, P. (2003). Sampling biases in IP topology measurements. In INFOCOM 2003, Twenty-Second Annual Joint Conference of the IEEE Computer and Communications. IEEE Societies 1332–341. IEEE, New York.
29. LESKOVEC, J. and FALOUTSOS, C. (2006). Sampling from large graphs. In Proceedings of the 12th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining631–636. ACM, New York.
30. LI, J.-Y. and YEH, M.-Y. (2011). On sampling type distribution from heterogeneous social networks. In Advances in Knowledge Discovery and Data Mining 111–122. Springer, Berlin.
31. LIM, Y.-S., MENASCHÉ, D. S., RIBEIRO, B., TOWSLEY, D. and BASU, P. (2011). Online estimating the k central nodes of a network. In Network Science Workshop (NSW), 2011. IEEE118–122. IEEE, New York.
32. LOVÁSZ, L. (1993). Combinatorial Problems and Exercises, 2nd ed. North-Holland, Amsterdam.
33. LU, X. and BRESSAN, S. (2012). Sampling connected induced subgraphs uniformly at random. In Scientific and Statistical Database Management 195–212. Springer, Berlin.
34. MAIYA, A. S. and Berger-Wolf, T. Y. (2010a). Online sampling of high centrality individuals in social networks. In Advances in Knowledge Discovery and Data Mining 91–98. Springer, Berlin.
35. MAIYA, A. S. and Berger-Wolf, T. Y. (2010b). Sampling community structure. In Proceedings of the 19th International Conference on World Wide Web701–710. ACM, New York.
36. MISLOVE, A., MARCON, M., GUMMADI, K. P., DRUSCHEL, P. and BHATTACHARJEE, B. (2007). Measurement and analysis of online social networks. In Proceedings of the 7th ACM SIGCOMM Conference on Internet Measurement29–42. ACM, New York.
37. MOHAISEN, A., LUO, P., LI, Y., KIM, Y. and ZHANG, Z.-L. (2012). Measuring bias in the mixing time of social graphs due to graph sampling. In Military Communications Conference, 2012- MILCOM 2012 1–6, IEEE, New York.
38. Pastor-Satorras, R. and VESPIGNANI, A. (2001). Epidemic spreading in scale-free networks. Phys. Rev. Lett. 86 3200.
39. RAMANI, S., BLU, T. and UNSER, M. (2008). Monte-Carlo SURE: A black-box optimization of regularization parameters for general denoising algorithms. IEEE Trans. Image Process. 17 1540–1554 MR2517100.
40. RIBEIRO, B. and TOWSLEY, D. (2010). Estimating and sampling graphs with multidimensional random walks. In Proceedings of the 10th ACM SIGCOMM Conference on Internet Measurement390–403. ACM, New York.
41. ROLLS, D. A., DARAGANOVA, G., Sacks-Davis, R., HELLARD, M., JENKINSON, R., MCBRYDE, E., PATTISON, P. E. and ROBINS, G. L. (2012). Modelling hepatitis C transmission over a social network of injecting drug users. J. Theoret. Biol. 297 73–87 MR2899019.
42. SALEHI, M., RABIEE, H. R., NABAVI, N. and POOYA, S. (2011). Characterizing twitter with respondent-driven sampling. In Dependable, Autonomic and Secure Computing (DASC), 2011. IEEE Ninth International Conference on1211–1217. IEEE, New York.
43. SHI, X., BONNER, M., ADAMIC, L. A. and GILBERT, A. C. (2008). The very small world of the well-connected. In Proceedings of the Nineteenth ACM Conference on Hypertext and Hypermedia 61–70. ACM, New York.
44. STUMPF, M. P. H. and WIUF, C. (2005). Sampling properties of random graphs: The degree distribution. Phys. Rev. E(3) 72 036118 MR2179923.
45. STUMPF, M. P. H., WIUF, C. and MAY, R. M. (2005). Subnets of scale-free networks are not scalefree: Sampling properties of networks. Proc. Natl. Acad. Sci. USA 102 4221–4224.
46. VAN MIEGHEM, P. (2011). Graph Spectra for Complex Networks. Cambridge Univ. Press, Cambridge. MR2767173.
47. VAN MIEGHEM, P., OMIC, J. and KOOIJ, R. (2009). Virus spread in networks. IEEE/ACM Transactions on Networking 17 1–14.
48. WANG, T., CHEN, Y., ZHANG, Z., XU, T., JIN, L., HUI, P., DENG, B. and LI, X. (2011). Understanding graph sampling algorithms for social network analysis. In Distributed Computing Systems Workshops (ICDCSW), 2011 31st International Conference on123–128. IEEE, New York.
49. YANG, J. and LESKOVEC, J. (2012). Defining and evaluating network communities based on ground-truth. In Proceedings of the ACM SIGKDDWorkshop on Mining Data Semantics 3. ACM, New York.
50. YOON, S.-H., KIM, K.-N., KIM, S.-W. and PARK, S. (2011). A community-based sampling method using DPL for online social network. CoRRabs/1109.1063.
51. ZHOU, J., LI, Y., ADHIKARI, V. K. and ZHANG, Z.-L. (2011). Counting youtube videos via random prefix sampling. In Proceedings of the 2011, ACM SIGCOMM Conference on Internet Measurement Conference371–380. ACM, New York.