SAE: Toward Efficient Cloud Data Analysis Service for Large-Scale Social Networks

IEEE Transactions on Cloud Computing

Volumn 5, Issue 3, 2017, Pages 563-575

  Zhang, Yu ^a   Liao, Xiaofei ^a   Jin, Hai ^a   Tan, Guang ^b  

^a HUAZHONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (China)

^b SHENZHEN INSTITUTES OF ADVANCED TECHNOLOGY   (China)

Author keywords

Cloud service; communication skew; computation decomposition; computational skew; social network analysis

Indexed keywords

DATA HANDLING; INFORMATION ANALYSIS; PARALLEL PROGRAMMING; SOCIAL NETWORKING (ONLINE);

CLOUD SERVICES; CLUSTERS OF COMPUTERS; COMPUTATIONAL SKEW; DECOMPOSITION METHODS; EXTRACTION PROCESS; LOAD BALANCING TECHNIQUE; PARALLEL EXECUTIONS; PARALLEL PLATFORMS;

DISTRIBUTED COMPUTER SYSTEMS;

EID: 85030111604     PISSN: None     EISSN: 21687161     Source Type: Journal    
DOI: 10.1109/TCC.2015.2415810     Document Type: Article

References (31)

1. Z. Song and N. Roussopoulos, "K-nearest neighbor search for moving query point, " Lecture Notes Comput. Sci., vol. 2121, pp. 79-96, Jul. 2001.
2. X. Yu, K. Q. Pu, and N. Koudas, "Monitoring k-nearest neighbor queries over moving objects, " in Proc. 21st Int. Conf. Data Eng., 2005, pp. 631-642.
3. T. Kanungo, D. M. Mount, N. S. Netanyahu, C. D. Piatko, R. Silverman, and A. Y. Wu, "An efficient k-means clustering algorithm: Analysis and implementation, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 7, pp. 881-892, Jul. 2002.
4. L. Di Stefano and A. Bulgarelli, "A simple and efficient connected components labeling algorithm, " in Proc. Int. Conf. Image Anal. Process., 1999, pp. 322-327.
5. E. Deelman, G. Singh, M.-H. Su, J. Blythe, Y. Gil, C. Kesselman, G. Mehta, K. Vahi, G. B. Berriman, J. Good, A. Laity, J. C. Jacob, and D. S. Katz, "Pegasus: A framework for mapping complex scientific workflows onto distributed systems, " Sci. Program., vol. 13, no. 3, pp. 219-237, Jan. 2006.
6. L. Katz, "A new status index derived from sociometric analysis, " Psychometrika, vol. 18, no. 1, pp. 39-43, Mar. 1953.
7. D. Liben-Nowell and J. Kleinberg, "The link prediction problem for social networks, " in Proc. 12th Int. Conf. Inf. Knowl. Manage., 2003, pp. 556-559.
8. S. Baluja, R. Seth, D. Sivakumar, Y. Jing, J. Yagnik, S. Kumar, D. Ravichandran, and M. Aly, "Video suggestion and discovery for youtube: Taking random walks through the view graph, " in Proc. 17th Int. Conf. World Wide Web, 2008, pp. 895-904.
9. S. Brin and L. Page, "The anatomy of a large-scale hypertextual web search engine, " Comput. Netw. ISDN Syst., vol. 30, no. 1, pp. 107-117, Apr. 1998.
10. S. Baluja, R. Seth, D. Sivakumar, Y. Jing, J. Yagnik, S. Kumar, D. Ravichandran, and M. Aly, "Video suggestion and discovery for youtube: Taking random walks through the view graph, " in Proc. 17th Int. Conf. World Wide Web, 2008, pp. 895-904.
11. H. H. Song, T. W. Cho, V. Dave, Y. Zhang, and L. Qiu, "Scalable proximity estimation and link prediction in online social networks, " in Proc. 9th ACM SIGCOMM Conf. Internet Meas. Conf., 2009, pp. 322-335.
12. Y. Zhang, X. Liao, H. Jin, and G. Min, "Resisting skewaccumulation for time-stepped applications in the cloud via exploiting parallelism, " IEEE Trans. Cloud Comput., vol. 3, no. 1, pp. 54-65, 2015.
13. M. E. Newman and M. Girvan, "Finding and evaluating community structure in networks, " Phys. Rev. E, vol. 69, no. 2, pp. 26-113, Feb. 2004.
14. I. D. Couzin, J. Krause, N. R. Franks, and S. A. Levin, "Effective leadership and decision-making in animal groups on the move, " Nature, vol. 433, no. 7025, pp. 513-516, Feb. 2005.
15. S. Banerjee and N. Agarwal, "Analyzing collective behavior from blogs using swarm intelligence, " Knowl. Inf. Syst., vol. 33, no. 3, pp. 523-547, Dec. 2012.
16. G. Wang, M. Salles, B. Sowell, X. Wang, T. Cao, A. Demers, J. Gehrke, and W. White, "Behavioral simulations in mapreduce, " Proc. VLDB Endowment, vol. 3, no. 1/2, pp. 952-963, Sep. 2010.
17. B. Raney and K. Nagel, "Iterative route planning for large-scale modular transportation simulations, " Future Gener. Comput. Syst., vol. 20, no. 7, pp. 1101-1118, Oct. 2004.
18. Y. Zhang, X. Liao, H. Jin, G. Tan, and G. Min, "Inc-part: Incremental partitioning for load balancing in large-scale behavioral simulations, " IEEE Trans. Parallel Distrib. Syst., pp. 1-11, 2014, Doi: 10. 1109/TPDS. 2014. 2333511.
19. H. P. Haewoon Kwak, Changhyun Lee, and S. Moon (2010). What is twitter, a social network or a new media? [Online]. Available: http://an. kaist. ac. kr/traces/WWW2010. html
20. Y. Kwon, M. Balazinska, B. Howe, and J. Rolia, "Skew-resistant parallel processing of feature-extracting scientific user-defined functions, " in Proc. 1st ACM Symp. Cloud Comput., 2010, pp. 75-86.
21. J. E. Gonzalez, Y. Low, H. Gu, D. Bickson, and C. Guestrin, "Powergraph: Distributed graph-parallel computation on natural graphs, " in Proc. 10th USENIX Conf. Oper. Syst. Des. Implementation, 2012, pp. 17-30.
22. J. Lifflander, S. Krishnamoorthy, and L. V. Kale, "Work stealing and persistence-based load balancers for iterative overdecomposed applications, " in Proc. 21st Int. Symp. High-Perform. Parallel Distrib. Comput., 2012, pp. 137-148.
23. H. Kwak, C. Lee, H. Park, and S. Moon, "What is twitter, a social network or a news media?" in Proc. 19th Int. Conf. World Wide Web, 2010, pp. 591-600.
24. R. Power and J. Li, "Piccolo: Building fast, distributed programs with partitioned tables, " in Proc. 9th USENIX Conf. Oper. Syst. Des. Implementation, 2010, pp. 1-14.
25. Y. Zhang, X. Liao, H. Jin, and B. B. Zhou, "Asyiter: tolerating computational skew of synchronous iterative applications via computing decomposition, " Knowl. Inf. Syst., vol. 41, no. 2, pp. 379-400, 2014.
26. Y. Zhang, X. Liao, H. Jin, L. Lin, and F. Lu, "An adaptive switching scheme for iterative computing in the cloud, " Frontiers Comput. Sci., vol. 8, no. 6, pp. 872-884, 2014.
27. O. Pearce, T. Gamblin, B. R. de Supinski, M. Schulz, and N. M. Amato, "Quantifying the effectiveness of load balance algorithms, " in Proc. 26thACMInt. Conf. Supercomput., 2012, pp. 185-194.
28. G. Zheng, E. Meneses, A. Bhatele, and L. V. Kale, "Hierarchical load balancing for charm++ applications on large supercomputers, " in Proc. 39th Int. Conf. Parallel Program. Workshops, 2010, pp. 436-444.
29. B. Acun, A. Gupta, N. Jain, A. Langer, H. Menon, E. Mikida, X. Ni, M. Robson, Y. Sun, E. Totoni, L. Wesolowski, and L. Kale, "Parallel programming with migratable objects: Charm++ in practice, " in Proc. Int. Conf. High Perform. Comput., Netw., Storage Anal., 2014, pp. 647-658.
30. G. Ananthanarayanan, S. Kandula, A. Greenberg, I. Stoica, Y. Lu, B. Saha, and E. Harris, "Reining in the outliers in map-reduce clusters using mantri, " in Proc. 9th USENIX Conf. Oper. Syst. Des. Implementation, 2010, pp. 1-16.
31. Y. Kwon, M. Balazinska, B. Howe, and J. Rolia, "SkewTune: Mitigating skew in mapreduce applications, " in Proc. Int. Conf. Manage. Data, 2012, pp. 25-36.