Adapting scientific computing problems to clouds using MapReduce

Future Generation Computer Systems

Volumn 28, Issue 1, 2012, Pages 184-192

  Srirama, Satish Narayana ^a   Jakovits, Pelle ^a   Vainikko, Eero ^a  

^a UNIVERSITY OF TARTU   (Estonia)

Author keywords

Cloud computing; Hadoop; Iterative algorithm; MapReduce; Scientific computing; Twister

Indexed keywords

COMPUTING FRAMEWORKS; CRITICAL PROBLEMS; HADOOP; ITERATIVE ALGORITHM; MAP-REDUCE; SCIENTIFIC COMPUTING APPLICATIONS; TWISTER;

ALGORITHMS; CLOUDS; ITERATIVE METHODS; MATHEMATICAL MODELS; NATURAL SCIENCES COMPUTING; PROBLEM SOLVING;

CLOUD COMPUTING;

EID: 80052795836     PISSN: 0167739X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.future.2011.05.025     Document Type: Conference Paper

References (28)

1. R. Buyya, C.S. Yeo, S. Venugopal, J. Broberg, and I. Brandic Cloud computing and emerging it platforms: vision, hype, and reality for delivering computing as the 5th utility Future Generation Computer Systems 25 2009 599 616
2. S.N. Srirama, O. Batrashev, E. Vainikko, Scicloud: scientific computing on the cloud, in: The 10th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, CCGrid 2010, p. 579.
3. S.G. Jeffrey Dean, MapReduce: simplified data processing on large clusters, in: Proc. of the 6th OSDI.
4. Apache Software Foundation, Hadoop, 2011. http://wiki.apache.org/hadoop/.
5. S. Ghemawat, H. Gobioff, and S.-T. Leung The google file system SIGOPS Operating Systems Review 37 2003 29 43 (Pubitemid 40929686)
6. J. Cohen Graph twiddling in a MapReduce world Computing in Science and Engineering 11 2009 29 41
7. C. Bunch, B. Drawert, M. Norman, Mapscale: a cloud environment for scientific computing, Technical Report, University of California, Computer Science Department, 2009.
8. Google Inc., App engine java overview, 2011. http://code.google.com/ appengine/docs/java/overview.html.
9. Amazon Inc., Amazon elastic compute cloud (Amazon ec2), 2011. http://aws.amazon.com/ec2/.
10. Eucalyptus Systems Inc., Eucalyptus, 2011. http://www.eucalyptus.com.
11. S. Srirama, and M. Jarke Mobile hosts in enterprise service integration International Journal of Web Engineering and Technology (IJWET) 5 2009 187 213
12. K. Gottschalk, S. Graham, H. Kreger, and J. Snell Introduction to web services architecture IBM Systems Journal: New Developments in Web Services and E-commerce 41 2 2002 178 198
13. S.N. Srirama, M. Jarke, and W. Prinz Mobile web services mediation framework Middleware for Service Oriented Computing (MW4SOC) Workshop @ 8th Int. Middleware Conf. 2007 2007 ACM Press
14. S.N. Srirama, V. Shor, E. Vainikko, and M. Jarke Scalable mobile web services mediation framework Fifth Int. Conf. on Internet and Web Applications and Services ICIW 2010 2010 IEEE CS 315 320
15. Apache Software Foundation, Hdfs, 2011. http://hadoop.apache.org/common/ docs/current/hdfsdesign.html.
16. J.R. Shewchuk, An introduction to the conjugate gradient method without the agonizing pain, Technical Report, Pittsburgh, PA, USA, 1994.
17. L. Kaufman, and P. Rousseeuw Finding Groups in Data An Introduction to Cluster Analysis 1990 Wiley Interscience New York
18. C. Pomerance A tale of two sieves Notices of the American Mathematical Society 43 1996 1473 1485
19. J. Ekanayake, H. Li, B. Zhang, T. Gunarathne, S.-H. Bae, J. Qiu, and G. Fox Twister: a runtime for iterative MapReduce Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing HPDC'10 2010 ACM New York, NY, USA 810 818
20. J. Ekanayake, X. Qiu, T. Gunarathne, S. Beason, G. Fox, High performance parallel computing with cloud and cloud technologies, Technical Report, Indiana University, 2009.
21. Y. Bu, B. Howe, M. Balazinska, M.D. Ernst, HaLoop: efficient iterative data processing on large clusters, in: 36th International Conference on Very Large Data Bases, Singapore.
22. M. Zaharia, M. Chowdhury, M.J. Franklin, S. Shenker, I. Stoica, Spark: cluster computing with working sets, in: 2nd USENIX Conf. on Hot Topics in Cloud Computing, HotCloud'10, p. 10.
23. G. Malewicz, M.H. Austern, A.J. Bik, J.C. Dehnert, I. Horn, N. Leiser, and G. Czajkowski Pregel: a system for large-scale graph processing Proceedings of the 2010 International Conference on Management of Data 2010 ACM 135 146
24. W.F. McColl Scalability, portability and predictability: the bsp approach to parallel programming Future Generation Computer Systems 12 1996 265 272 Parallel Computing Applications (Pubitemid 126686551)
25. C. Ranger, R. Raghuraman, A. Penmetsa, G. Bradski, and C. Kozyrakis Evaluating MapReduce for multi-core and multiprocessor systems 13th International Symposium on High Performance Computer Architecture HPCA 07 2007 IEEE CS 13 24 (Pubitemid 47208148)
26. S. Sehgal, M. Erdelyi, A. Merzky, and S. Jha Understanding application-level interoperability: Scaling-out MapReduce over high-performancee Grids and clouds Future Generation Computer Systems 27 2011 590 599
27. C. Robert, and G. Casella Monte Carlo Statistical Methods 2004 Springer Verlag
28. S. Branford, C. Sahin, A. Thandavan, V. Alexandrov, and I. Dimov Monte Carlo methods for matrix computations on the Grid Future Generation Computer Systems 24 2008 605 612 (Pubitemid 351470012)