Addressing big data issues in Scientific Data Infrastructure

Proceedings of the 2013 International Conference on Collaboration Technologies and Systems, CTS 2013

Volumn , Issue , 2013, Pages 48-55

  Demchenko, Yuri ^a   Grosso, Paola ^a   De Laat, Cees ^a   Membrey, Peter ^b  

^a UNIVERSITY OF AMSTERDAM   (Netherlands)

^b HONG KONG POLYTECHNIC UNIVERSITY   (Hong Kong)

Author keywords

Big Data Infrastructure; Big Data Science; Cloud Infrastructure Service; Scientific Data Infrastructure (SDI); Scientific Data Lifecycle Management (SDLM)

Indexed keywords

BEST PRACTICES; BIG DATUM; CLOUD INFRASTRUCTURES; GENERIC ARCHITECTURE; INFRASTRUCTURE SERVICES; MODERN TECHNOLOGIES; SCIENTIFIC COMMUNITY; SCIENTIFIC DATA;

INFORMATION MANAGEMENT;

LIFE CYCLE;

EID: 84883290116     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CTS.2013.6567203     Document Type: Conference Paper

References (41)

1. Global Research Data Infrastructures: Towards a 10-year vision for global research data infrastructures. Final Roadmap, March 2012. [online] http://www. grdi2020. eu/Repository/FileScaricati/6bdc07fb-b21d-4b90-81d4-d909fdb96b87. pdf
2. Riding the wave: How Europe can gain from the rising tide of scientific data. Final report of the High Level Expert Group on Scientific Data. October 2010. [online] Available at http://cordis. europa. eu/fp7/ict/e-infrastructure/ docs/hlg-sdi-report. pdf
3. Y. Demchenko, Z. Zhao, P. Grosso, A. Wibisono, C. de Laat, Addressing Big Data Challenges for Scientific Data Infrastructure. The 4th IEEE Conf. on Cloud Computing Technologies and Science (CloudCom2012), 3-6 December 2012, Taipei, Taiwan. ISBN: 978-1-4673-4509-5
4. Reflections on Big Data, Data Science and Related Subjects. Blog by Irving Wladawsky-Berger. [online] http://blog. irvingwb. com/blog/2013/01/ reflections-on-big-data-data-science-and-related-subjects. html
5. E. Dumbill, What is big data? An introduction to the big data landscape. [online] http://strata. oreilly. com/2012/01/what-is-big-data. html
6. What is big data? IBM. [online] http://www-01. ibm. com/software/data/ bigdata/
7. Roundup of Big Data Pundits' Predictions for 2013. Blog post by David Pittman. January 18, 2013. [online] http://www. ibmbigdatahub. com/blog/roundup-big-data-pundits-predictions-2013
8. Big Data prediction for 2013. Blog by Mike Gualtieri. [online] http://blogs. forrester. com/mike-gualtieri
9. The Forrester Wave: Big Data Predictive Analytics Solutions, Q1 2013. Mike Gualtieri, January 13, 2013. [online] http://www. forrester. com/pimages/rws/reprints/document/85601/oid/1-LTEQDI
10. The Big Data Long Tail. Blog post by Jason Bloomberg on Jan 17, 2013. [online] http://www. devx. com/blog/the-big-data-long-tail. html
11. The Fourth Paradigm: Data-Intensive Scientific Discovery. Edited by Tony Hey, Stewart Tansley, and Kristin Tolle. Microsoft Corporation, October 2009. ISBN 978-0-9825442-0-4 [online] http://research. microsoft. com/en-us/ collaboration/fourthparadigm/
12. The 3Vs that define Big Data. Posted by Diya Soubra on July 5, 2012 [online] http://www. datasciencecentral. com/forum/topics/the-3vs-that-define- big-data
13. European Union. A Study on Authentication and Authorisation Platforms For Scientific Resources in Europe. Brussels : European Commission, 2012. Final Report. Contributing author. Internal identification SMART-Nr 2011/0056. [online] Available at http://cordis. europa. eu/fp7/ict/e-infrastructure/docs/ aaa-study-final-report. pdf
14. Federated Identity Management for Research Collaborations. Final version. Reference CERN-OPEN-2012-006. [online] https://cdsweb. cern. ch/record/1442597
15. SIENA European Roadmap on Grid and Cloud Standards for e-Science and Beyond. SIENA Project report. [online] http://www. sienainitiative. eu/Repository/Filescaricati/ 8ee3587a-f255-4e5c-aed4-9c2dc7b626f6. pdf
16. Seeking new horizons: EGI's role for 2020. [online] http://www. egi. eu/blog/2012/03/09/seeking-new-horizons-egis-role-for-2020. html
17. Future Internet Report. UK Future Internet Strategy Group. May 2011. [online] https://connect. innovateuk. org/c/document-library/get-file?folderId= 861750&name=DLFE-33761. pdf
18. Worldwide Large Hadron Collider Grid (WLCG) [online] http://wlcg. web. cern. ch/
19. European Data Protection Directive. [online] http://ec. europa. eu/justice/data-protection/index-en. htm
20. D. Koopa, et al, A Provenance-Based Infrastructure to Support the Life Cycle of Executable Papers, International Conference on Computational Science, ICCS 2011. [online] http://vgc. poly. edu/~juliana/pub/vistrails-executable- paper. pdf
21. Open Access: Opportunities and Challenges. European Commission for UNESCO. [online] http://ec. europa. eu/research/science-society/document- library/pdf-06/open-access-handbook-en. pdf
22. OpenAIR-Open Access Infrastructure for Research in Europe. [online] http://www. openaire. eu/
23. Open Researcher and Contributor ID. [online] http://about. orcid. org/
24. Data Lifecycle Models and Concepts. [online] http://wgiss. ceos. org/dsig/whitepapers/Data%20Lifecycle%20Models%20and%20Concepts%20v8. docx
25. EGI federated cloud task force. [online] http://www. egi. eu/infrastructure/cloud/cloudtaskforce. html
26. eduGAIN-Federated access to network services and applications. [online] http://www. edugain. org
27. Editorial: Special section: Optiplanet- The optiputer global collaboratory L Smarr, M Brown, C de Laat Future Generation Computer SysEditorial: Special section: Optiplanet- The optiputer global collaboratory L Smarr, M Brown, C de Laat Future Generation Computer Systems 25 (2), 109-113
28. R. Grossman, Y. Gu, X. Hong, A. Antony, J. Blom, F. Dijkstra, and C. de Laat, Teraflows over Gigabit WANs with UDT, Journal of Future Computer Systems, Elsevier Press, Volume 21, Number 4, 2005, pages 501-513.
29. Y. Demchenko, C. Ngo, M. Makkes, R. Strijkers, C. de Laat, Defining Inter-Cloud Architecture for Interoperability and Integration. The 3rd Int'l Conf. on Cloud Computing, GRIDs, and Virtualization CLOUD COMPUTING 2012, July 22-27, 2012, Nice, France
30. Cloud Reference Framework. Internet-Draft, version 0. 4, December 27, 2012. [online] http://www. ietf. org/id/draft-khasnabish-cloud-reference- framework-04. txt
31. A chart of the big data ecosystem, take 2. By Matt Turk [online] http://mattturck. com/2012/10/15/a-chart-of-the-big-data-ecosystem-take-2/
32. Amazon Big Data. [online] http://aws. amazon. com/big-data/
33. Microsoft Azure Big Data. [online] http://www. windowsazure. com/en-us/home/scenarios/big-data/
34. IBM Big Data Analytics. [online] http://www-01. ibm. com/software/data/ infosphere/bigdata-analytics. html
35. Cloudera Impala Big Data Platform http://www. cloudera. com/content/cloudera/en/home. html
36. 10 hot big data startups to watch in 2013, 10 January 2013 [online] http://beautifuldata. net/2013/01/10-hot-big-data-startups-to-watch-in-2013/
37. Y. Demchenko, C. de Laat, V. Ciaschini, VO-based dynamic security associations in collaborative grid environment Collaborative Technologies and Systems, 2006. CTS 2006. International
38. Y. Demchenko, A. Wan, M. Cristea, C. De Laat, Authorisation infrastructure for on-demand network resource provisioning, Grid Computing, 2008 9th IEEE/ACM International Conference on, 95-103
39. Y. Demchenko, C. de Laat, L. Gommans, B. Oudenaarde, A. Tokmakoff, M. Snijders, Job-centric security model for open collaborative environment
40. Y. Demchenko, M. Cristea, C. de Laat, Collaborative Technologies and Systems, 2005. Proceedings of the 2005 XACML policy profile for multidomain network resource provisioning and supporting authorisation infrastructure. Policies for Distributed Systems and Networks, 2009. POLICY 2009. IEEE.
41. Research Data Alliance (RDA). [online] http://rd-alliance. org/