A modular software architecture for processing of big geospatial data in the cloud

Computers and Graphics (Pergamon)

Volumn 49, Issue , 2015, Pages 69-81

  Krämer, Michel ^a,b   Senner, Julia ^a  

^a FRAUNHOFER IGD   (Germany)

^b DARMSTADT UNIVERSITY OF TECHNOLOGY   (Germany)

Author keywords

Big Data; Cloud computing; Distributed systems; Domain specific languages; Geoprocessing; Software architectures

Indexed keywords

BIG DATA; CHAINS; DIGITAL SUBSCRIBER LINES; DISTRIBUTED COMPUTER SYSTEMS; FILE ORGANIZATION; PROBLEM ORIENTED LANGUAGES; SOFTWARE ARCHITECTURE; USER INTERFACES;

CLOUD INFRASTRUCTURES; CLOUD-COMPUTING; DISTRIBUTED SYSTEMS; DOMAINS SPECIFIC LANGUAGES; GEO-SPATIAL DATA; GEOPROCESSING; GEOSPATIAL DATA SET; MODULAR SOFTWARE ARCHITECTURES; MODULARS; WORK-FLOWS;

MANAGERS;

EID: 84938199684     PISSN: 00978493     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.cag.2015.02.005     Document Type: Article

References (40)

1. M. Krämer, and A. Kehlenbach Interactive, GPU-based urban growth simulation for agile urban policy modelling W. Rekdalsbakken, R. Bye, H. Zhang, Proceedings of the 27th European conference on modelling and simulation (ECMS) 2013 European Council for Modelling and Simulation Ålesund, Norway 75 81
2. R. Cossu, C. Di Giulio, F. Brito, and D. Petcu Cloud computing for earth observation D. Kyriazis, A. Voulodimos, S.V. Gogouvitis, T. Varvarigou, Data intensive storage services for cloud environments 2013 IGI Global Hershey, PA, USA 166 191 ISBN 9781466639348; http://dx.doi.org/10.4018/978-1-4666-3934-8, Chapter 12
3. Li J, Humphrey M, Agarwal D, Jackson K, van Ingen C, Ryu Y. eScience in the cloud: a MODIS satellite data reprojection and reduction pipeline in the Windows Azure platform. In: 2010 IEEE international symposium on parallel distributed processing (IPDPS). 2010. p. 1-10. http://dx.doi.org/10.1109/IPDPS.2010.5470418.
4. G. Giuliani, S. Nativi, A. Lehmann, and N. Ray {WPS} mediation: an approach to process geospatial data on different computing backends Comput Geosci 47 0 2012 20 33 http://dx.doi.org/10.1016/j.cageo.2011.10.009; towards a Geoprocessing Web
5. Qazi N, Smyth D, McCarthy T. Towards a GIS-based decision support system on the amazon cloud for the modelling of domestic wastewater treatment solutions in Wexford, Ireland. In: 2013 UKSim 15th international conference on computer modelling and simulation (UKSim). 2013. p. 236-40. http://dx.doi.org/10.1109/UKSim.2013.62.
6. M.H.A. Kuo Opportunities and challenges of cloud computing to improve health care services J Med Internet Res 13 3 2011 e67 10.2196/jmir.1867
7. M. Batty Big data, smart cities and city planning Dialogues Hum Geogr 3 3 2013 274 279 10.1177/2043820613513390
8. Khan Z, Kiani SL. A cloud-based architecture for citizen services in smart cities. In: Proceedings of the 2012 IEEE/ACM fifth international conference on utility and cloud computing, UCC '12. Washington, DC, USA: IEEE Computer Society; 2012. p. 315-20. ISBN 978-0-7695-4862-3. http://dx.doi.org/10.1109/UCC.2012.43.
9. Khan Z, Anjum A, Kiani SL. Cloud based big data analytics for smart future cities. In: Proceedings of the 2013 IEEE/ACM 6th international conference on utility and cloud computing, UCC '13. Washington, DC, USA: IEEE Computer Society; 2013. p. 381-6. ISBN 978-0-7695-5152-4. http://dx.doi.org/10.1109/UCC.2013.77.
10. Mell P, Grance T. The NIST definition of cloud computing. Technical report 800-145. Gaithersburg, MD: National Institute of Standards and Technology (NIST); 2011.
11. Agarwal D, Prasad S. Lessons learnt from the development of GIS application on Azure cloud platform. In: 2012 IEEE 5th international conference on cloud computing (CLOUD). 2012. p. 352-9. http://dx.doi.org/10.1109/CLOUD.2012.140.
12. M. Malawski, T. Gubała, and M. Bubak Component-based approach for programming and running scientific applications on grids and clouds Int J High Perform Comput Appl 26 3 2012 275 295 10.1177/1094342011422924
13. J. Dean, and S. Ghemawat MapReduce: simplified data processing on large clusters Commun ACM 51 1 2008 1 13 10.1145/1327452.1327492
14. P. Haller, and M. Odersky Scala actors: unifying thread-based and event-based programming Theor Comput Sci 410 2-3 2009 202 220 http://dx.doi.org/10.1016/j.tcs.2008.09.019
15. Zaharia M, Chowdhury M, Franklin MJ, Shenker S, Stoica I. Spark: cluster computing with working sets. In: Proceedings of the 2nd USENIX conference on hot topics in cloud computing. 2010. p. 10.
16. Eldawy A, Li Y, Mokbel MF, Janardan R. CG-Hadoop: computational geometry in MapReduce. In: 21st ACM SIGSPATIAL international conference on advances in geographic information systems (ACM SIGSPATIAL GIS 2013), 2013.
17. Ajiy A, Sun X, Vo H, Liu Q, Lee R, Zhang X, et al. Demonstration of Hadoop-GIS: a spatial data warehousing system over mapreduce. In: 21st ACM SIGSPATIAL international conference on advances in geographic information systems (ACM SIGSPATIAL GIS 2013), 2013.
18. Xin R, Rosen J, Zaharia M, Franklin MJ, Shenker S, Stoica I. Shark: SQL and rich analytics at scale. In: Proceedings of the ACM SIGMOD/PODS conference, 2013.
19. Deelman E, Vahi K, Juve G, Rynge M, Callaghan S, Maechling PJ, et al. Pegasus: a workflow management system for science automation. Future Gener Comput Syst 2015;46:17-35. 10.1016/j.future.2014.10.008.
20. K.N. Whitley Visual programming languages and the empirical evidence for and against J Vis Lang Comput 8 1 1997 109 142 http://dx.doi.org/10.1006/jvlc.1996.0030
21. D. Rosenberg, and K. Scott Use case driven object modeling with uml: a practical approach 1999 Addison-Wesley Professional Berkeley, CA, USA ISBN 0201432897
22. Belényesi M, Kristóf D, editors. IQmulus public project deliverable D1.2.1 - initial user requirements. Technical report; 2014.
23. Belényesi M, Kristóf D, editors. IQmulus public project deliverable D1.2.2 - consolidated user requirements. Technical report; 2014.
24. Belényesi M, Kristóf D, editors. IQmulus public project deliverable D1.2.3 - revised user requirements. Technical report; 2014.
25. Krämer M, Kießlich N, Spagnulo M. IQmulus public project deliverable D2.3.1 - architecture design - baseline version. Technical report; 2014.
26. Beyer MA, Laney D. The importance of 'big data': a definition. Technical report. Gartner; 2012.
27. Krämer M. Controlling the processing of smart city data in the cloud with domain-specific languages. In: Proceedings of the 7th international conference on utility and cloud computing (UCC). 2014. p. 824-829. 10.1109/UCC.2014.134.
28. Khan ZA, Ludlow D, McClatchey R, Anjum A. An architecture for integrated intelligence in urban management using cloud computing. CoRR 2012;abs/1202.5483; 2012.
29. U. Zdun, R. Capilla, H. Tran, and O. Zimmermann Sustainable architectural design decisions IEEE Softw 30 6 2013 46 53 10.1109/MS.2013.97
30. H.P. Breivold, I. Crnkovic, and M. Larsson A systematic review of software architecture evolution research Inf Softw Technol 54 1 2012 16 40
31. W.E. Wong, H.B. Christensen, and K.M. Hansen An empirical investigation of architectural prototyping J Syst Softw 83 1 2010 133 142
32. J. Bosch Design and use of software architectures: adopting and evolving a product-line approach 2000 Addison-Wesley Professional Harlow, UK ISBN 0201674947
33. Olston C, Reed B, Srivastava U, Kumar R, Tomkins A. Pig latin: a not-so-foreign language for data processing. In: Proceedings of the 2008 ACM SIGMOD international conference on management of data, SIGMOD '08. New York, NY, USA: ACM; 2008. p. 1099-110. ISBN 978-1-60558-102-6. http://dx.doi.org/10.1145/1376616.1376726.
34. Eldawy A, Mokbel M. Pigeon: a spatial mapreduce language. In: Proceedings of the IEEE international conference on data engineering (ICDE), 2014.
35. Depardon B, Mahec GL, Séguin C. Analysis of six distributed file systems. Technical report. HAL; 2014.
36. Zaharia M, Chowdhury M, Franklin MJ, Shenker S, Stoica I. Spark: cluster computing with working sets. In: Proceedings of the 2nd USENIX conference on hot topics in cloud computing. Berkeley, CA, USA: USENIX Association; 2010.
37. Fielding RT. Architectural styles and the design of network-based software architectures [Ph.D. thesis]. University of California; 2000. http://dx.doi.org/10.1016/1.1.91.2433.
38. D. Gaševic, D. Djuric, and V. Devedžic Model driven engineering and ontology development 2nd ed 2009 Springer Berlin, Heidelberg ISBN 978-3-642-00282-3
39. Provos N, Mazières D. A future-adaptable password scheme. In: USENIX annual technical conference, FREENIX track, 1999. p. 81-91.
40. M. Malawski, J. Meizner, M. Bubak, and P. Gepner Component approach to computational applications on clouds Procedia Comput Sci 4 2011 432 441 http://dx.doi.org/10.1016/j.procs.2011.04.045; proceedings of the international conference on computational science, {ICCS} 2011