Variable-sized map and locality-aware reduce on public-resource grids

Future Generation Computer Systems

Volumn 27, Issue 6, 2011, Pages 843-849

  Su, Yen Liang ^a   Chen, Po Cheng ^a   Chang, Jyh Biau ^b   Shieh, Ce Kuen ^a  

^a NATIONAL CHENG KUNG UNIVERSITY   (Taiwan)

^b LEADER UNIVERSITY   (Taiwan)

Author keywords

Grid computing; Load balance; MapReduce; Scheduling

Indexed keywords

COMPUTING POWER; COMPUTING RESOURCE; GRID ENVIRONMENTS; GRID NODE; LOAD BALANCE; MAP TASK; MAP-REDUCE; NOVEL TASK; RUNTIME SYSTEMS;

DATA TRANSFER; SCHEDULING ALGORITHMS; WIDE AREA NETWORKS;

GRID COMPUTING;

EID: 79953212189     PISSN: 0167739X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.future.2010.09.001     Document Type: Conference Paper

References (16)

1. J. Dean, and S. Ghemawat MapReduce: simplified data processing on large clusters Communications of the ACM 51 2008 107 114
2. Applications and organizations using Hadoop. http://wiki.apache.org/ hadoop/PoweredBy.
3. Hadoop. http://hadoop.apache.org/.
4. C. Ranger, R. Raghuraman, A. Penmetsa, G. Bradski, and C. Kozyrakis Evaluating MapReduce for multi-core and multiprocessor systems Proceedings of the 13th IEEE International Symposium on High Performance Computer Architecture 2007 IEEE Computer Society Phoenix, Arizona 13 24 (Pubitemid 47208148)
5. B. He, W. Fang, Q. Luo, N.K. Govindaraju, and T. Wang Mars: a MapReduce framework on graphics processors Proceedings of the 17th ACM International Conference on Parallel Architectures and Compilation Techniques 2008 ACM Toronto, Ontario 260 269
6. M.M. Rafique, B. Rose, A.R. Butt, and D.S. Nikolopoulos Supporting MapReduce on large-scale asymmetric multi-core clusters SIGOPS Operating Systems Review 43 2009 25 34
7. M. Zaharia, A. Konwinski, A. Joseph, R. Katz, I. Stoica, Improving mapreduce performance in heterogeneous environments, in: 8th USENIX Symposium on Operating Systems Design and Implementation, San Diego, CA, 2008.
8. S. Ibrahim, H. Jin, B. Cheng, H. Cao, S. Wu, and L. Qi CLOUDLET: towards mapreduce implementation on virtual machines Proceedings of the 18th ACM International Symposium on High Performance Distributed Computing 2009 ACM Garching, Germany 65 66
9. A. Matsunaga, M. Tsugawa, and J. Fortes CloudBLAST: combining MapReduce and virtualization on distributed resources for bioinformatics applications Proceedings of the 4th IEEE International Conference on e-Science 2008 IEEE Computer Society 222 229
10. A. Merzky, K. Stamou, and S. Jha Application level interoperability between clouds and grids Proceedings of the 2009 Workshops at the Grid and Pervasive Computing Conference 2009 IEEE Computer Society 143 150
11. C. Jin, and R. Buyya MapReduce programming model for~.NET-based cloud computing Proceedings of the 15th International Euro-Par Conference on Parallel Processing 2009 Springer-Verlag Delft, The Netherlands 417 428
12. C. Xingchen, K. Nadiminti, J. Chao, S. Venugopal, R. Buyya, Aneka: next-generation enterprise grid platform for e-science and e-business applications, in: Proceeding of the IEEE International Conference on e-Science and Grid Computing, 2007, pp. 151159.
13. T.-Y. Liang, C.-Y. Wu, J.-B. Chang, C.-K. Shieh, Teamster-G: a grid-enabled software DSM system, in: Proceeding of the IEEE International Symposium on Cluster Computing and the Grid, vol. 902, 2005, pp. 905912. (Pubitemid 44868414)
14. P.-C. Chen, J.-B. Chang, T.-Y. Liang, and C.-K. Shieh A progressive multi-layer resource reconfiguration framework for time-shared grid systems Future Generation Computer Systems 25 2009 662 673
15. I. Foster Globus toolkit version 4: software for service-oriented systems Journal of Computer Science and Technology 21 2006 513 520 (Pubitemid 46224406)
16. P.-C. Chen, J.-B. Chang, Y.-L. Su, and C.-K. Shieh On-demand data co-allocation with user-level cache for grids Concurrency and Computation: Practice and Experience 2010