Big Data challenges in building the Global Earth Observation System of Systems

Environmental Modelling and Software

Volumn 68, Issue , 2015, Pages 1-26

  Nativi, Stefano ^a   Mazzetti, Paolo ^a   Santoro, Mattia ^a   Papeschi, Fabrizio ^a   Craglia, Max ^b   Ochiai, Osamu ^c  

^a CNR   (Italy)

^b JOINT RESEARCH CENTRE   (Italy)

^c GEO Secretariat   (Switzerland)

Author keywords

Big Data; Cloud systems; Earth System Science; GEOSS; Interoperability; Multidisciplinary systems; Research infrastructures

Indexed keywords

DATA VISUALIZATION; DECISION MAKING; INTEROPERABILITY; OBSERVATORIES; SYSTEMS ENGINEERING;

CLOUD SYSTEMS; EARTH SYSTEM SCIENCE; GEOSS; MULTI-DISCIPLINARY SYSTEMS; RESEARCH INFRASTRUCTURE;

BIG DATA;

DATA ACQUISITION; DECISION MAKING; ENVIRONMENTAL MANAGEMENT; EOS; GLOBAL PERSPECTIVE; PERFORMANCE ASSESSMENT; REAL TIME; SOFTWARE;

EID: 84923054501     PISSN: 13648152     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.envsoft.2015.01.017     Document Type: Article

References (53)

1. Albani M., Nebert D., Percivall G., Miura S., Craglia M., Nativi S., Ochiai O., Volden E. AWorking Meeting for the Vision and Architecture of GEOSS Information System: Outcome Report, GEO Document 2013, Available at:. ftp://ftp.earthobservations.org/meetings/20130920_GEOSS_Arch/.
2. Bargellini P., Cheli S., Desmos Y.L., Greco B., Guidetti V., Marchetti P.G., Comparetto C., Nativi S., Sawjer G. Big Data from Space: Event Report, European Space Agency Publication 2013, Available at:. http://www.congrexprojects.com/docs/default-source/13c10_docs/13c10_event_report.pdf?sfvrsn=2.
3. Bigagli L., Nativi S., Mazzetti P., Villoresi G. GI-Cat: a Web Service for Dataset Cataloguing Based on ISO 19115, Database and Expert Systems Applications, 2004 2004, Proceedings. 15th International Workshop on, pp. 846, 850, 30 Aug.-3 Sept. 2004. 10.1109/DEXA.2004.1333582.
4. Boicea A., Radulescu F., Agapin L.I. MongoDB vs Oracle - Database Comparison, 2012 Third International Conference on Emerging Intelligent Data and Web Technologies (EIDWT) 2012, pp. 330-335, 19-21 Sept. 2012. 10.1109/EIDWT.2012.32.
5. Boldrini E., Nativi S. SeaDataNet Metadata Profile of ISO 19115, SeaDataNet Publication 2013, Available at:. http://www.seadatanet.org/content/download/20284/140589/file/CDI-profile-V10.0.pdf.
6. Boldrini E., Nativi S., Santoro M., Papeschi F., Mazzetti P. GI-axe: an Access Broker Framework for the Geosciences, AGU Fall Meeting Abstracts 2012 2012, Available at:. http://meetingorganizer.copernicus.org/EGU2013/EGU2013-7777.pdf.
7. Boldrini Enrico, Santoro Mattia, Papeschi Fabrizio, Nativi Stefano "Data Access Services Interoperability in the Geosciences by Means of the GI-axe Brokering Framework" EGU General Assembly Conference Abstracts 2013, vol. 15:EGU2013-7777.
8. Bondi A.B. Characteristics of scalability and their impact on performance. Proceedings of the Second International Workshop on Software and Performance - WOSP '00 2000, 195-203. ACM, New York.
9. Busse S., Kutsche R.D., Leser U., Weber H. Federated Information Systems: Concepts, Terminology and Architectures 1999, Forschungsberichte des Fachbereichs Informatik Bericht Nr. 99-9, Available at:. http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.71.8618%26rep=rep1%26type=pdf.
10. Castaner S. Access to EUMETSAT Data, Workshop on GMES Data and Information Policy, Brussels 12-13 Jan 2012 2012, Available at:. http://file:///C:/Users/Stefano/Downloads/Thursday12-1-2012_Session3_EUMETSAT_P.Counet_7145%20(1).pdf.
11. Chang F., Dean J., Ghemawat S., Hsieh W.C., Wallach D.A., Burrows M., Chandra T., Fikes A., Gruber R.E. Bigtable: a Distributed Storage System for Structured Data, ACM Transactions on Computer Systems (TOCS) TOCS Homepage Archive June 2008, vol. 26 (2).
12. Cocco M. The European Plate Observing System (EPOS): Integrated Services for Solid Earth Science, ESA Big Data from Space Conference, Frascati 2013, Available at:. http://www.congrexprojects.com/docs/default-source/13c10_docs/session-3a.zip.
13. COCOS (Coordination Action carbon Observation System) Report on the role of European observations in the context of global carbon, deliverable reference num. D 6.3 Available at:. http://sci.martinkoechy.de/papers/D6.3EuropeanObservationsSmall.pdf.
14. DeLaurentis D., Dickerson C., DiMario M., Gartz P., Jamshidi M., Nahavandi S., Sage A., Sloane E., Walker D. "A case for an international consortium on system of systems engineering," Technical Note. IEEE Syst. J. 2007, 1(No. 1):68-73. Sept.
15. Dhar V. Data Science and Prediction, Communications of the ACM 2013, vol. 56 (12):64-73.
16. Domenico B., Nativi S. OGC International Standard, OGC Document 11-165r2. CF-netCDF3 Data Model Extension Standard (v. 3.1) 2013, Available at:. https://portal.opengeospatial.org/files/?artifact_id=51908.
17. Domenico B., Caron J., Davis E., Kambic R., Nativi S. Thematic real-time environmental distributed data services (THREDDS): incorporating interactive analysis tools into NSDL. J.Digital Inf. 2006, Available at:. https://journals.tdl.org/jodi/index.php/jodi/article/viewArticle/51/54.
18. Erickson T. Google Earth Engine: a Global-scale Geospatial Analysis Platform, ESA Big Data from Space Conference, Frascati 2013, Available at:. http://www.congrexprojects.com/docs/default-source/13c10_docs/session-1c.zip?sfvrsn=2.
19. GEO GEOSS: 10-Year Implementation Plan Reference Document, ESA Publications Division 2005, Available at:. http://www.earthobservations.org/documents/10-Year%20Plan%20Reference%20Document.pdf.
20. GEO Strategic Guidance for Current and Potential Contributors to GEOSS, Printed by JAXA on behalf of GEO Architecture and Data Committee, Oct 2007 2007, Available at:. https://www.earthobservations.org/documents/portal/25_Strategic%20Guidance%20Document.pdf.
21. GEO GEOSS Strategic Targets Document 12(Rev1) as Accepted at GEO-VI 2009, Available at:. http://www.earthobservations.org/documents/geo_vi/12_GEOSS%20Strategic%20Targets%20Rev1.pdf.
22. GEO GEO 2012-2015 Work Plan, GEO Publication 2012, Available at:. http://www.earthobservations.org/documents/work%20plan/GEO%202012-2015%20Work%20Plan_Rev2.pdf.
23. GEO DSWG GEOSS Data Quality Guidelines 2003, Available at:. https://www.earthobservations.org/documents/dsp/GEOSS_Data_Quality_Guidelines.pdf.
24. Metadata Extraction Quality Component 2012, GeoViQua Consortium, Available at:. http://www.geoviqua.org/Docs/SubmittedDeliverables/D3_1_GeoViQua.pdf.
25. User Feedback Elicitation Tool 2013, GeoViQua Consortium, Available at:. http://www.geoviqua.org/Docs/SubmittedDeliverables/D3_2_GeoViQua.pdf.
26. Gudivada V.N., Rao D., Raghavan V.V. NoSQL Systems for Big Data Management, IEEE World Congress on Services 2014 2014, pp. 190-197, June 27 2014-July 2 2014. 10.1109/SERVICES.2014.42.
27. Han Jing, Haihong E., Le Guan, Du Jian Survey on NoSQL Database, 6th International Conference on Pervasive Computing and Applications (ICPCA) 2011, pp. 363-366, 26-28 Oct. 2011. 10.1109/ICPCA.2011.6106531.
28. The Fourth Paradigm: Data-intensive Scientific Discovery 2009, 252. Microsoft Corporation edition. T. Hey, S. Tansley, K. Tolle (Eds.).
29. Jacobs T., Borstlap G., Bartholomé E., Maathuis B.H.P. DevCoCast in Support of Environmental Management and Sustainable Development in Africa 2008, 7th International Conference of African Association of Remote Sensing of the Environment (AARSE) on Earth Observation and Geo-Information for Governance in Africa, Accra, Ghana.
30. Jamshidi M. System of Systems Engineering - Innovations for the 21st Century 2009, Wiley, New York.
31. Karcanias N., Hessami A.G. Complexity and the notion of System of Systems: General Systems and Complexity. Proceedings of 2010 World Automation Congress International Symposium on Intelligent Automation and Control (ISIAC) 19-23 September 2010, Kobe Japan 2010.
32. Kaur K., Rani R. Modeling and Querying Data in NoSQL Databases, IEEE International Conference on Big Data 2013, pp. 1-7, 6-9 Oct. 2013. 10.1109/BigData.2013.6691765.
33. Krootjes P. Applications of Large Scale Floating Car Data Collection from Consumer Navigation Systems, ESA Big Data from Space Conference, Frascati 2013, Available at:. http://www.congrexprojects.com/docs/default-source/13c10_docs/session-1b.zip.
34. Laney D. 3D Data Management: Controlling Data Volume, Velocity and Variety February 2001, Gartner. Available at:. http://blogs.gartner.com/doug-laney/files/2012/01/ad949-3D-Data-Management-Controlling-Data-Volume-Velocity-and-Variety.pdf.
35. Mell P., Grance T. The NIST Definition of Cloud Computing 2011, NIST SP-800-145, available at:, (last accessed 30.10.14.). http://www.profsandhu.com/cs6393_s13/nist-SP800-145.pdf.
36. Naheman W., Wei Jianxin Review of NoSQL databases and performance testing on HBase. Proceedings 2013 International Conference on, pp. 2304, 2309, 20-22 Dec. 2013 2013, Mechatronic Sciences, Electric Engineering and Computer (MEC).
37. Nativi S., Bigagli L. Discovery, mediation, and access services for earth observation data. IEEE J. Sel. Top. Appl. Earth Observ. Remote Sens. 2009, 2(4):233-240.
38. Nativi S., Caron J., Domenico B., Bigagli L. Unidata's common data model mapping to the ISO 19123 data model. Earth Sci. Inf. 2008, 1(2):59-78.
39. Nativi S., Khalsa S.J., Domenico B., Craglia M., Pearlman J., Mazzetti P., Rew R. The Brokering Approach for Earth Science Cyber Infrastructure 2011, NSF EarthCube White Paper, Available at:. http://https://rd-alliance.org/system/files/filedepot/97/earthcube(BrokeringApproachhttps://rd-alliance.org/system/files/filedepot/97/earthcube(BrokeringApproach)_v3.3.pdf.
40. Nativi S., Craglia M., Pearlman J. The brokering approach for multidisciplinary interoperability: a position paper. Int. J. Spatial Data Infrastruct. Res. 2012, 7:1-15.
41. Nativi S., Mazzetti P., Geller G. Environmental model access and interoperability: the GEO Model Web initiative. Environ. Model. Softw. 2012, 1-15.
42. Nativi S., Craglia M., Pearlman J. Earth science infrastructures interoperability: the brokering approach. IEEE JSTARS 2013, 6(3):118-1129.
43. OpenGIS Catalogue Services Specification Version 2.0.2 2007, Open Geospatial Consortium (OGC), OGC 07-006r1.
44. Pereira H.M., et al. Essential biodiversity variables. Science 2013, 339. 18 January 2013, pp. 277-278. Available at: https://www.earthobservations.org/documents/cop/bi_geobon/ebvs/201301_ebv_paper_pereira_et_al.pdf.
45. The Guide to the Systems Engineering Body of Knowledge (SEBoK) 2013, vol. 1.2. The Trustees of the Stevens Institute of Technology, Hoboken, NJ, (accessed 15.11.13.). http://www.sebokwiki.org/.
46. QA4EO task team AQuality Assurance Framework for Earth Observation: Principles 2010, Available at:. http://qa4eo.org/docs/QA4EO_Principles_v4.0.pdf.
47. Rebovich G. Enterprise System of Systems. Systems of Systems Engineering - Principles and Applications 2009, (Chapter 6), CRC Press, Boca Raton, FL, USA.
48. Santoro Mattia, Mazzetti Paolo, Nativi Stefano, Fugazza Cristiano, Granell Carlos, Diaz Laura Methodologies for augmented discovery of geospatial resources. Discovery of Geospatial Resources: Methodologies, Technologies, and Emergent Applications 2012, Carlos Granell and Joaquin Huerta, 172-203. Hershey, PA: Infromation Science Reference. L. Diaz (Ed.).
49. Santoro M., Wei Y., Boldrini E., Pearlman J., Cook R.B., Nativi S. Brokering Services to Evaluate, Visualize, and Analyze Terrestrial Biosphere Model Output and Observations. EGU General Assembly 2013 2013, EGU2013-7679.
50. Santoro M., Sorichetta A., Roglia E., Quaglia A., Craglia M., Nativi S. Improve the Ranking Algorithm of the GEO Discovery and Access Broker through Resource Accessibility Assessment. AGU Fall Meeting Abstracts 2013.
51. Santoro M., Bigagli L., Roncella R., Mazzetti P., Nativi S. Towards a Brokering Framework for Business Process Execution. EGU General Assembly 2013 2013, id. EGU2013-7543.
52. USGS Terrestrial Essential Climate Variables (ECVs) at a Glance 2011, Available at:. http://pubs.usgs.gov/sim/3155/pdf/SIM11-3155.pdf.
53. Vaccari L., Craglia M., Fugazza C., Nativi S., Santoro M. Integrative research: the EuroGEOSS experience. IEEE J. Sel. Top. Appl. Earth Observations Remote Sens. December 2012, 5(6):1603-1611.