Hierarchical MapReduce programming model and scheduling algorithms

Proceedings - 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, CCGrid 2012

Volumn , Issue , 2012, Pages 769-774

  Luo, Yuan ^a   Plale, Beth ^a  

^a INDIANA UNIVERSITY   (United States)

Author keywords

Cross Domain; Data Intensive; MapReduce; Multi Cluster

Indexed keywords

COMPUTATION RESOURCES; CROSS-DOMAIN; DATA INTENSIVE; DATA LOCATION; EXPERIMENTAL EVALUATION; MAP-REDUCE; MOLECULE BINDING; MULTI-CLUSTER; PREDICTION TOOLS; PROGRAMMING MODELS;

GRID COMPUTING; SCHEDULING;

COMPUTER PROGRAMMING;

EID: 84863694915     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CCGrid.2012.132     Document Type: Conference Paper

References (16)

1. J. Dean and S. Ghemawat, "Mapreduce: simplified data processing on large clusters," Commun. ACM, vol. 51, pp. 107-113, January 2008.
2. "FutureGrid," http://www.futuregrid.org.
3. "Teragrid," http://www.teragrid.org.
4. Y. Luo, Z. Guo, Y. Sun, B. Plale, J. Qiu, and W. W. Li, "A hierarchical framework for cross-domain mapreduce execution," in Proceedings of the second international workshop on Emerging computational methods for the life sciences, ser. ECMLS '11. New York, NY, USA: ACM, 2011, pp. 15-22.
5. M. Elteir, H. Lin, and W.-c. Feng, "Enhancing mapreduce via asynchronous data processing," in Proceedings of the 2010 IEEE 16th International Conference on Parallel and Distributed Systems, ser. ICPADS '10. Washington, DC, USA: IEEE Computer Society, 2010, pp. 397-405.
6. G. M. Morris, R. Huey, W. Lindstrom, M. F. Sanner, R. K. Belew, D. S. Goodsell, and A. J. Olson, "Autodock4 and autodocktools4: Automated docking with selective receptor flexibility," Journal of Computational Chemistry, vol. 30, no. 16, pp. 2785-2791, 2009.
7. K. Shvachko, H. Kuang, S. Radia, and R. Chansler, "The hadoop distributed file system," in Proceedings of the 2010 IEEE 26th Symposium on Mass Storage Systems and Technologies (MSST), ser. MSST '10. Washington, DC, USA: IEEE Computer Society, 2010, pp. 1-10.
8. O. Tatebe, K. Hiraga, and N. Soda, "Gfarm grid file system," New Generation Computing, vol. 28, pp. 257-275, 2010, 10.1007/s00354-009-0089-5.
9. C. Zheng, D. Abramson, P. Arzberger, S. Ayyub, C. Enticott, S. Garic, M. J. Katz, J.-H. Kwak, B. S. Lee, P. M. Papadopoulos, S. Phatanapherom, S. Sriprayoonsakul, Y. Tanaka, Y. Tanimura, O. Tatebe, and P. Uthayopas, "The pragma testbed - building a multi-application international grid," in Proceedings of the Sixth IEEE International Symposium on Cluster Computing and the Grid, ser. CCGRID '06. Washington, DC, USA: IEEE Computer Society, 2006, pp. 57-.
10. H.-c. Yang, A. Dasdan, R.-L. Hsiao, and D. S. Parker, "Mapreduce-merge: simplified relational data processing on large clusters," in Proceedings of the 2007 ACM SIGMOD international conference on Management of data, ser. SIGMOD '07. New York, NY, USA: ACM, 2007, pp. 1029-1040.
11. M. Cardosa, C. Wang, A. Nangia, A. Chandra, and J. Weissman, "Exploring mapreduce efficiency with highly-distributed data," in Proceedings of the second international workshop on MapReduce and its applications, ser. MapReduce '11. New York, NY, USA: ACM, 2011, pp. 27-34.
12. K. Keahey, M. Tsugawa, A. Matsunaga, and J. Fortes, "Sky computing," IEEE Internet Computing, vol. 13, pp. 43-51, September 2009.
13. M. Tsugawa and J. A. B. Fortes, "A virtual network (vine) architecture for grid computing," in Proceedings of the 20th international conference on Parallel and distributed processing, ser. IPDPS'06. Washington, DC, USA: IEEE Computer Society, 2006, pp. 148-148.
14. B. Glahn, A. Taylor, N. Kurkowski, and W. A. Shaffer, "The role of the slosh model in national weather service storm surge forecasting," National Weather Digest, vol. 33, pp. 3-14, 2009.
15. "Hathi Trust Research Center," http://www.hathitrust.org/htrc.
16. "Hathi Trust Digital Library," http://www.hathitrust.org.