An adaptive framework for the execution of data-intensive MapReduce applications in the Cloud

IEEE International Symposium on Parallel and Distributed Processing Workshops and Phd Forum

Volumn , Issue , 2011, Pages 1122-1131

  Koehler, Martin ^a   Kaniovskyi, Yuriy ^a   Benkner, Siegfried ^a  

^a UNIVERSITY OF VIENNA   (Austria)

Author keywords

Adaptive; Autonomic computing; Cloud; MapReduce

Indexed keywords

ABSTRACTION LAYER; ADAPTIVE; ADAPTIVE FRAMEWORK; APPLICATION DEVELOPMENT ENVIRONMENT; APPLICATION LAYERS; AUTONOMIC COMPUTING; COMPUTING TECHNOLOGY; DATA-INTENSIVE APPLICATION; DISTRIBUTED DATA; DISTRIBUTED FILE SYSTEMS; EXPERIMENTAL EVALUATION; GRID COMPUTING TECHNOLOGY; HISTORIC DATA; MAP-REDUCE; MOLECULAR SYSTEMS; OPTIMIZATION FRAMEWORK; PROGRAMMING MODELS; SCIENTIFIC APPLICATIONS; SELF-CONFIGURING; SERVICE ORIENTED; STORAGE INFRASTRUCTURE; UTILITY FUNCTIONS; VIENNA GRID ENVIRONMENTS;

ABSTRACTING; CLOUDS; COMPUTER PROGRAMMING; DISTRIBUTED PARAMETER NETWORKS; GRID COMPUTING; OPTIMIZATION;

CLOUD COMPUTING;

EID: 83455229788     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IPDPS.2011.254     Document Type: Conference Paper

References (21)

1. "CERN: Worldwide LHC computing grid," http://public.web.cern. ch/public/en/lhc/Computing-en.html.
2. J. Dean and S. Ghemawat, "Mapreduce: simplified data processing on large clusters," Commun. ACM, vol. 51, pp. 107-113, January 2008. [Online]. Available: http://doi.acm.org/10.1145/1327452.1327492
3. I. Foster, Y. Zhao, I. Raicu, and S. Lu, "Cloud computing and grid computing 360-degree compared," in Grid Computing Environments Workshop, 2008. GCE '08, 2008, pp. 1-10. [Online]. Available: http://dx.doi.org/10.1109/ GCE.2008.4738445
4. S. Benkner, I. Brandic, G. Engelbrecht, and R. Schmidt, "Vge - a service-oriented grid environment for on-demand supercomputing," in Proceedings of the Fifth IEEE/ACM International Workshop on Grid Computing (Grid 2004), November 2004.
5. S. Benkner, G. Engelbrecht, M. Koehler, and A. Woehrer, "Virtualizing scientific applications and data sources as grid services," in Cyberinfrastructure Technologies and Applications, J. Cao, Ed. Nova Science Publishers, 2009.
6. Impetus, "Whitepaper: Deriving intelligence from large data using hadoop and applying analytics."
7. J. Kephart and D. Chess, "The vision of autonomic computing," Computer, vol. 36, no. 1, pp. 41 - 50, Jan. 2003.
8. M. C. Huebscher and J. A. McCann, "A survey of autonomic computing - degrees, models, and applications," ACM Comput. Surv., vol. 40, pp. 7:1-7:28, August 2008. [Online]. Available: http://doi.acm.org/10.1145/1380584. 1380585
9. W. Walsh, G. Tesauro, J. Kephart, and R. Das, "Utility functions in autonomic systems," in Autonomic Computing, 2004. Proceedings. International Conference on, May 2004, pp. 70 - 77.
10. S. Benkner, G. Berti, G. Engelbrecht, J. Fingberg, G. Kohring, S. Middleton, and R. Schmidt, "Gemss: Grid-infrastructure for medical service provision," in Proceedings of HealthGRID 2004, January 2004.
11. H. Rajasekaran, P. Hasselmeyer, L. L. Iacono, J. Fingberg, P. Summers, S. Benkner, G. Engelbrecht, A. Arbona, A. Chiarini, C. Friedrich, M. Hofmann-Apitius, B. Moore, P. Bijlenga, J. Iavindrasana, H. Müller, R. Hose, R. Dunlop, A. Frangi, and K. Kumpf, "@neurIST - Towards a System Architecture for Advanced Disease Managment through Integration of Heterogeneous Data, Computing, and Complex Processing Services," in IEEE International Symposium on Computer-Based Medical Systems. Jyväskylä, Finland: IEEE Computer Society Press, June 2008.
12. I. Janciak, C. Kloner, and P. Brezany, "Workflow enactment engine for wsrf-compliant services orchestration," in In The 9th IEEE/ACM International Conference on Grid Computing, 2008.
13. M. Koehler and S. Benkner, "A service oriented approach for distributed data mediation on the grid," in Grid and Cooperative Computing, 2009. GCC '09. Eighth International Conference on, Lanzhou, Gansu, China, August 2009, pp. 401-408. [Online]. Available: http://dx.doi.org/10.1109/GCC. 2009.35
14. M. Koehler, M. Ruckenbauer, I. Janciak, S. Benkner, H. Lischka, and W. N. Gansterer, "A grid services cloud for molecular modelling workflows," International Journal of Web and Grid Services (IJWGS), vol. 6, no. 2, pp. 176 - 195, 2010.
15. M. Koehler, M. Ruckenbauer, I. Janciak, S. Benkner, H. Lischka, and W. Gansterer, "Supporting molecular modeling workflows within a grid services cloud," in Computational Science and Its Applications ICCSA 2010, ser. Lecture Notes in Computer Science, D. Taniar, O. Gervasi, B. Murgante, E. Pardede, and B. Apduhan, Eds. Springer Berlin / Heidelberg, 2010, vol. 6019, pp. 13-28.
16. J. Hummel, M. Niemann, S. Wienkoop, W. Schulze, D. Steinhauser, J. Selbig, D. Walther, and W. Weckwerth, "Promex: a mass spectral reference database for proteins and protein phosphorylation sites," vol. 8, no. 1, 2007, p. 216. [Online]. Available: http://www.biomedcentral.com/1471-2105/8/216
17. "Configuring the hadoop integration," http://wikis.sun.com/ display/gridengine62u5/Configuring+the+Hadoop+Integration.
18. M. Rodriguez-Martinez, J. Seguel, and M. Greer, "Open source cloud computing tools: A case study with a weather application," Cloud Computing, IEEE International Conference on, vol. 0, pp. 443-449, 2010.
19. R. Buyya, S. Pandey, and C. Vecchiola, "Cloudbus toolkit for market-oriented cloud computing," in Proceedings of the 1st International Conference on Cloud Computing, ser. CloudCom '09. Berlin, Heidelberg: Springer-Verlag, 2009, pp. 24-44.
20. P. Padala, K. G. Shin, X. Zhu, M. Uysal, Z. Wang, S. Singhal, A. Merchant, and K. Salem, "Adaptive control of virtualized resources in utility computing environments," SIGOPS Oper. Syst. Rev., vol. 41, pp. 289-302, March 2007.
21. "Towards an autonomic computing testbed," in Hot Topics in Autonomic Computing on Hot Topics in Autonomic Computing. Berkeley, CA, USA: USENIX Association, 2007, pp. 1-1. [Online]. Available: http://portal.acm.org/ citation.cfm?id=1288246.1288247