Priter: A distributed framework for prioritizing iterative computations

IEEE Transactions on Parallel and Distributed Systems

Volumn 24, Issue 9, 2013, Pages 1884-1893

  Zhang, Yanfeng ^a   Gao, Qixin ^b   Gao, Lixin ^c   Wang, Cuirong ^b  

^a NORTHEASTERN UNIVERSITY   (China)

^b NORTHEASTERN UNIVERSITY AT QINHUANGDAO   (China)

^c University of Massachusetts   (United States)

Author keywords

distributed framework; iterative algorithms; MapReduce; prioritized iteration; PrIter

Indexed keywords

DISTRIBUTED FRAMEWORK; ITERATIVE ALGORITHM; MAP-REDUCE; PRIORITIZED ITERATION; PRITER;

ALGORITHMS; DISTRIBUTED COMPUTER SYSTEMS; SOCIAL NETWORKING (ONLINE);

ITERATIVE METHODS;

EID: 84881036997     PISSN: 10459219     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPDS.2012.272     Document Type: Article

References (32)

1. Y. Zhang, Q. Gao, L. Gao, and C. Wang, "Priter: A Distributed Framework for Prioritized Iterative Computations," Proc. ACM Symp. Cloud Computing (SOCC '11), 2011.
2. S. Brin and L. Page, "The Anatomy of a Large-Scale Hypertextual Web Search Engine," Proc. Seventh Int'l Conf. World Wide Web (WWW '98), pp. 107-117, 1998.
3. S. Baluja, R. Seth, D. Sivakumar, Y. Jing, J. Yagnik, S. Kumar, D. Ravichandran, and M. Aly, "Video Suggestion and Discovery for Youtube: Taking Random Walks Through the View Graph," Proc. Int'l Conf. World Wide Web (WWW '08), pp. 895-904, 2008.
4. D. Liben-Nowell and J. Kleinberg, "The Link Prediction Problem for Social Networks," Proc. ACM Conf. Information and Knowledge Management (CIKM '03), pp. 556-559, 2003. (Pubitemid 40673595)
5. T. Zhou, Z. Kuscsik, J.-G. Liu, M. Medo, J.R. Wakeling, and Y.-C. Zhang, "Solving the Apparent Diversity-Accuracy Dilemma of Recommender Systems," Proc. Nat'l Academy of Sciences of USA, vol. 107, no. 10, pp. 4511-4515, Mar. 2010.
6. N. Slonim, N. Friedman, and N. Tishby, "Unsupervised Document Classification Using Sequential Information Maximization," Proc. 25th Ann. Int'l ACM SIGIR Conf. Research and Development in Information Retrieval, pp. 129-136, 2002.
7. J. Dean and S. Ghemawat, "Mapreduce: Simplified Data Processing on Large Clusters," Proc. USENIX Symp. Operating Systems Design & Implementation (OSDI '04), p. 10, 2004.
8. M. Isard, M. Budiu, Y. Yu, A. Birrell, and D. Fetterly, "Dryad: Distributed Data-Parallel Programs from Sequential Building Blocks," ACM SIGOPS Operating Systems Rev., vol. 41, pp. 59-72, Mar. 2007. (Pubitemid 47281575)
9. Y. Yu, M. Isard, D. Fetterly, M. Budiu, U. Erlingsson, P.K. Gunda, and J. Currey, "Dryadlinq: A System for General-Purpose Distributed Data-Parallel Computing Using a High-Level Language," Proc. USENIX Symp. Opearting Systems Design & Implementation (OSDI '08), pp. 1-14, 2008.
10. Hadoop, http://hadoop.apache.org/, 2013.
11. C. Olston, B. Reed, U. Srivastava, R. Kumar, and A. Tomkins, "Pig Latin: A Not-So-Foreign Language for Data Processing," Proc. ACM SIGMOD Int'l conf. Management of Data, pp. 1099-1110, 2008.
12. A. Thusoo, J.S. Sarma, N. Jain, Z. Shao, P. Chakka, S. Anthony, H. Liu, P. Wyckoff, and R. Murthy, "Hive: A Warehousing Solution over a Map-Reduce Framework," Proc. Int'l Conf. Very Large Database (VLDB '09), pp. 1626-1629, 2009.
13. G. Malewicz, M.H. Austern, A.J. Bik, J.C. Dehnert, I. Horn, N. Leiser, and G. Czajkowski, "Pregel: A System for Large-Scale Graph Processing," Proc. ACM SIGMOD Int'l Conf. Management of Data, pp. 135-146, 2010.
14. Amazon ec2, http://aws.amazon.com/ec2/, 2013.
15. H.H. Song, T.W. Cho, V. Dave, Y. Zhang, and L. Qiu, "Scalable Proximity Estimation and Link Prediction in Online Social Networks," Proc. Int'l Conf. Internet Measurement (IMC '09), pp. 322-335, 2009.
16. Y. Zhang, Q. Gao, L. Gao, and C. Wang, "Imapreduce: A Distributed Computing Framework for Iterative Computation," Proc. IEEE Int'l Workshop Data Intensive Cloud Computing (Data- Cloud '11), 2011.
17. R. Power and J. Li, "Piccolo: Building Fast, Distributed Programs with Partitioned Tables," Proc. USENIX Symp. Opearting Systems Design and Implementation (OSDI '10), 2010.
18. Priter project, http://code.google.com/p/priter/, 2013.
19. M. Zaharia, M. Chowdhury, M.J. Franklin, S. Shenker, and I. Stoica, "Spark: Cluster Computing with Working Sets," Proc. USENIX Workshop Hot Topics in Cloud Computing (HotCloud '10), 2010.
20. M. Zaharia, M. Chowdhury, T. Das, A. Dave, J. Ma, M. McCauley, M.J. Franklin, S. Shenker, and I. Stoica, "Resilient Distributed Datasets: A Fault-Tolerant Abstraction for. in-Memory Cluster Computing," Proc. Ninth USEINX Symp. Networked Systems Design and Implementation (NSDI '12), 2012.
21. A. Pavlo, E. Paulson, A. Rasin, D.J. Abadi, D.J. DeWitt, S. Madden, and M. Stonebraker, "A Comparison of Approaches to Large-Scale Data Analysis," Proc. ACM SIGMOD Int'l Conf. Management of Data, pp. 165-178, 2009.
22. T. Condie, N. Conway, P. Alvaro, J.M. Hellerstein, K. Elmeleegy, and R. Sears, "Mapreduce Online," Proc. USEINX Symp. Networked Systems Design and Implementation (NSDI '10), 2010.
23. J. Ekanayake, H. Li, B. Zhang, T. Gunarathne, S.-H. Bae, J. Qiu, and G. Fox, "Twister: A runtime for Iterative Mapreduce," Proc. IEEE Int'l Workshop MapReduce (MapReduce '10), pp. 810-818, 2010.
24. Y. Bu, B. Howe, M. Balazinska, and D.M. Ernst, "Haloop: Efficient Iterative Data Processing on Large Clusters," Proc. Int'l Conf. Very Large Database (VLDB '10), 2010.
25. D.G. Murray, M. Schwarzkopf, C. Smowton, S. Smith, A. Madhavapeddy, and S. Hand, "Ciel: A Universal Execution Engine for Distributed Data-Flow Computing," Proc. USEINX Symp. Networked Systems Design and Implementation (NSDI '11), 2011.
26. Y. Low, J. Gonzalez, A. Kyrola, D. Bickson, C. Guestrin, and J.M. Hellerstein, "Graphlab: A New Framework for Parallel Machine Learning," Proc. Int'l Conf. Uncertainty in Artificial Intelligence (UAI '10), 2010.
27. Y. Low, J. Gonzalez, A. Kyrola, D. Bickson, C. Guestrin, and J.M. Hellerstein, "Distributed Graphlab: A Framework for Machine Learningand Data Mining in the Cloud," Proc. Int'l Conf. Very Large Database (VLDB '12), 2012.
28. J.J. Dongarra, J. Du Croz, S. Hammarling, and R.J. Hanson, "An Extended Set of Fortran Basic Linear Algebra Subprograms," ACM Trans. Math. Software, vol. 14, no. 1, pp. 1-17, Mar. 1988. (Pubitemid 18618260)
29. E. Anderson, Z. Bai, C. Bischof, J. Demmel, J. Dongarra, J.D. Croz, A. Greenbaum, S. Hammarling, A. McKenney, S. Ostrouchov, and D. Sorensen, LAPACK's User's Guide. SIAM, 1992.
30. D. Chazan and W. Miranker, "Chaotic Relaxation," Linear Algebra and Its Applications, vol. 2, no. 2, pp. 199-222, 1969.
31. G.M. Baudet, "Asynchronous Iterative Methods for Multiprocessors," J. ACM, vol. 25, pp. 226-244, Apr. 1978.
32. D.P. Bertsekas, "Distributed Asynchronous Computation of Fixed Points," Math. Programming, vol. 27, pp. 107-120, 1983.