Variable-sized map and locality-aware reduce on public-resource grids

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 6104 LNCS, Issue , 2010, Pages 234-243

  Chen, Po Cheng ^a   Su, Yen Liang ^a   Chang, Jyh Biau ^b   Shieh, Ce Kuen ^a  

^a NATIONAL CHENG KUNG UNIVERSITY   (Taiwan)

^b LEADER UNIVERSITY   (Taiwan)

Author keywords

Heterogeneity; Load Balance; MapReduce; Non dedication; Public Resource Grids

Indexed keywords

COMPUTING POWER; COMPUTING RESOURCE; GRID ENVIRONMENTS; GRID NODE; LOAD BALANCE; MAP TASK; NOVEL TASK; PUBLIC RESOURCES; RUNTIME SYSTEMS;

DATA TRANSFER; GRID COMPUTING; MULTITASKING; QUERY LANGUAGES; SERVICE ORIENTED ARCHITECTURE (SOA);

SCHEDULING ALGORITHMS;

EID: 77953750708     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-13067-0_27     Document Type: Conference Paper

References (12)

1. Dean, J., Ghemawat, S.: MapReduce: Simplified data processing on large clusters. In: 6th USENIX Symposium on Operating Systems Design and Implementation. USENIX (2004)
2. Applications and organizations using Hadoop, http://wiki.apache.org/ hadoop/PoweredBy
3. Apache Hadoop, http://hadoop.apache.org/
4. Ranger, C., Raghuraman, R., Penmetsa, A., Bradski, G., Kozyrakis, C.: Evaluating MapReduce for Multi-core and Multiprocessor Systems. In: IEEE 13th International Symposium on High Performance Computer Architecture, pp. 13-24 (2007)
5. He, B., Fang, W., Luo, Q., Govindaraju, N.K., Wang, T.: Mars: a MapReduce framework on graphics processors. In: 17th International Conference on Parallel Architectures and Compilation Techniques, pp. 260-269. ACM, Toronto (2008)
6. Rafique, M.M., Rose, B., Butt, A.R., Nikolopoulos, D.S.: Supporting MapReduce on large-scale asymmetric multi-core clusters. ACM SIGOPS Operating Systems Review 43, 25-34 (2009)
7. Ibrahim, S., Jin, H., Cheng, B., Cao, H., Wu, S., Qi, L.: CLOUDLET: towards mapreduce implementation on virtual machines. In: 18th ACM International Symposium on High Performance Distributed Computing, pp. 65-66. ACM, Garching (2009)
8. Zaharia, M., Konwinski, A., Joseph, A., Katz, R., Stoica, I.: Improving mapreduce performance in heterogeneous environments. In: 8th USENIX Symposium on Operating Systems Design and Implementation. USENIX (2008)
9. Merzky, A., Stamou, K., Jha, S.: Application Level Interoperability between Clouds and Grids. In: Workshops at the Grid and Pervasive Computing Conference, pp. 143-150. IEEE Computer Society, Los Alamitos (2009)
10. Jin, C., Buyya, R.: MapReduce Programming Model for .NET-Based Cloud Computing. In: Sips, H., Epema, D., Lin, H.-X. (eds.) Euro-Par 2009 Parallel Processing. LNCS, vol.5704, pp. 417-428. Springer, Heidelberg (2009)
11. Liang, T.Y., Wu, C.Y., Chang, J.B., Shieh, C.K.: Teamster-G: a grid-enabled software DSM system. In: IEEE International Symposium on Cluster Computing and the Grid, vol.2 (2005)
12. Chen, P., Chang, J., Liang, T., Shieh, C.: A progressive multi-layer resource reconfiguration framework for time-shared grid systems. Future Generation Computer Systems 25, 662-673 (2009)