The little engine(s) that could: Scaling online social networks

Computer Communication Review

Volumn 40, Issue 4, 2010, Pages 375-386

  Pujol, Josep M ^a   Erramilli, Vijay ^a   Siganos, Georgos ^a   Yang, Xiaoyuan ^a   Laoutaris, Nikos ^a   Chhabra, Parminder ^a   Rodriguez, Pablo ^a  

^a TELEFONICA RESEARCH   (Spain)

Author keywords

Partition; Replication; Scalability; Social networks

Indexed keywords

APPLICATION DEVELOPERS; CASSANDRAS; CO-LOCATED; DATA LOCALITY; DESIGN CHALLENGES; FACEBOOK; HORIZONTAL SCALING; INTER-SERVER COMMUNICATIONS; ITS APPLICATIONS; KEY-VALUE STORES; LOCAL SEMANTICS; LOW MEMORY; NETWORK I/O; ON-LINE SOCIAL NETWORKS; ONLINE SOCIAL NETWORKS (OSNS); OPEN-SOURCE; REPLICATION; SINGLE SERVER; SOCIAL GRAPHS; SOCIAL NETWORKS; VERTICAL SCALING;

HETEROJUNCTION BIPOLAR TRANSISTORS; PARTITIONS (BUILDING); SCALABILITY; SEMANTICS; SYSTEMS ANALYSIS;

SOCIAL NETWORKING (ONLINE);

EID: 84860738074     PISSN: 01464833     EISSN: 19435819     Source Type: Conference Proceeding    
DOI: 10.1145/1851275.1851227     Document Type: Conference Paper

References (34)

1. Facebook's memcached multiget hole: More machines != more capacity. http://highscalability.com/blog/2009/10/26/facebooks-memcached-multiget-hole- more-machinesmore-capacit.html.
2. Friendster lost lead due to failure to scale. http://highscalability.com/ blog/2007/11/13/friendsterlost-lead-because-of-a-failure-to-scale.html.
3. Notes from scaling mysql up or out. http://venublog.com/2008/04/16/notes- from-scalingmysql-up-or-out/.
4. Rightscale. http://www.rightscale.com.
5. Status net. http://status.net.
6. Tsung: Distributed load testing tool. http://tsung.erlang-projects.org/.
7. Twitter architecture. http://highscalability.com/scaling-twitter- makingtwitter-10000-percent-faster.
8. A. Adya, W. J. Bolosky, M. Castro, G. Cermak, R. Chaiken, J. R. Douceur, Jon, J. Howell, J. R. Lorch, M. Theimer, and R. P. Wattenhofer. Farsite: Federated, available, and reliable storage for an incompletely trusted environment. In OSDI 02.
9. M. Armbrust, A. Fox, R. Griffith, A. D. Joseph, R. H. Katz, A. Konwinski, G. Lee, D. A. Patterson, A. Rabkin, I. Stoica, and M. Zaharia. Above the clouds: A berkeley view of cloud computing. Technical Report UCB/EECS-2009-28.
10. S. Arora, S. Rao, and U. Vazirani. Expander flows, geometric embeddings and graph partitioning. J. ACM, 56(2):1-37, 2009.
11. F. Benevenuto, T. Rodrigues, M. Cha, and V. Almeida. Characterizing user behavior in online social networks. In Proc. of IMC '09, pages 49-62, New York, NY, USA, 2009. ACM.
12. V. D. Blondel, J.-L. Guillaume, R. Lambiotte, and E. Lefebvre. Fast unfolding of communities in large networks. J.STAT.MECH., page P10008, 2008.
13. G. DeCandia, D. Hastorun, M. Jampani, G. Kakulapati, A. Lakshman, A. Pilchin, S. Sivasubramanian, P. Vosshall, and W. Vogels. Dynamo: amazon's highly available key-value store. SIGOPS Oper. Syst. Rev., 41(6):205-220, 2007.
14. M. R. Garey and D. S. Johnson. Computers and Intractability: A Guide to the Theory of NP-Completeness. W. H. Freeman & Co., New York, NY, USA, 1979.
15. R. G. Guy, J. S. Heidemann, W. Mak, T. W. Page, Jr., G. J. Popek, and D. Rothmeier. Implementation of the Ficus replicated file system. In USENIX Conference Proceedings, 1990.
16. J. Hamilton. Geo-replication at facebook. http://perspectives.mvdirona. com/2008/08/21/GeoReplicationAtFacebook.aspx.
17. J. Hamilton. Scaling linkedin. http://perspectives.mvdirona.com/2008/06/ 08/ScalingLinkedIn.aspx.
18. HighScalability.com. Why are facebook, digg and twitter so hard to scale? http://highscalability.com/blog/2009/10/13 /why-arefacebook-digg-and-twitter- so-hard-to-scale.html.
19. G. Karypis and V. Kumar. A fast and high quality multilevel scheme for partitioning irregular graphs. SIAM J. Sci. Comput., 20(1):359-392, 1998.
20. H. Kwak, Y. Choi, Y.-H. Eom, H. Jeong, and S. Moon. Mining communities in networks: a solution for consistency and its evaluation. In ACM IMC '09.
21. H. Kwak, C. Lee, H. Park, and S. Moon. What is twitter, a social network or a news media? 2010.
22. J. Leskovec, J. Kleinberg, and C. Faloutsos. Graph evolution: Densification and shrinking diameters. ACM Transactions on KDD, 1:1, 2007.
23. J. Leskovec, K. J. Lang, A. Dasgupta, and M. W. Mahoney. Community structure in large networks: Natural cluster sizes and the absence of large well-defined clusters. CoRR, abs/0810.1355, 2008.
24. N. Media. Growth of twitter. http://blog.nielsen.com/nielsenwire/online mobile/twitters-tweet-smell-of-success/.
25. A. Mislove, M. Marcon, K. P. Gummadi, P. Druschel, and B. Bhattacharjee. Measurement and analysis of online social networks. In ACM IMC '07.
26. M. Newman and J. Park. Why social networks are different from other types of networks. Phys. Rev. E, 68:036122, 2003.
27. M. E. J. Newman. Modularity and community structure in networks. PNAS, 103:8577, 2006.
28. J. M. Pujol, V. Erramilli, and P. Rodriguez. Divide and conquer: Partitioning online social networks. http://arxiv.org/abs/0905.4918v1, 2009.
29. J. M. Pujol, G. Siganos, V. Erramilli, and P. Rodriguez. Scaling online social networks without pains. In Proc of NETDB, 2009.
30. J. Rothschild. High performance at massive scale - lessons learned at facebook. http://cns.ucsd.edu/lecturearchive09.shtml#Roth.
31. M. Satyanarayanan. Coda: A highly available file system for a distributed workstation environment. IEEE Transactions on Computers, 39:447-459, 1990. (Pubitemid 20702255)
32. F. Schneider, A. Feldmann, B. Krishnamurthy, and W. Willinger. Understanding online social network usage from a network perspective. In IMC '09.
33. D. B. Terry, M. M. Theimer, K. Petersen, A. J. Demers, M. J. Spreitzer, and C. H. Hauser. Managing update conflicts in bayou, a weakly connected replicated storage system. In ACM SOSP '95.
34. B. Viswanath, A. Mislove, M. Cha, and K. P. Gummadi. On the evolution of user interaction in facebook. In Proc of WOSN'09).