Defining architecture components of the Big Data Ecosystem

2014 International Conference on Collaboration Technologies and Systems, CTS 2014

Volumn , Issue , 2014, Pages 104-112

  Demchenko, Yuri ^a   De Laat, Cees ^a   Membrey, Peter ^b  

^a UNIVERSITY OF AMSTERDAM   (Netherlands)

^b HONG KONG POLYTECHNIC UNIVERSITY   (Hong Kong)

Author keywords

Big Data Architecture Framework (BDAF); Big Data Ecosystem; Big Data Infrastructure (BDI); Big Data Lifecycle Management (BDLM); Big Data Technology; Cloud based Big Data Infrastructure Services

Indexed keywords

ECOSYSTEMS; LIFE CYCLE;

DATA ARCHITECTURES; DATA INFRASTRUCTURE; DATA LIFECYCLE MANAGEMENT; DATA TECHNOLOGIES; DATA-CENTRIC ARCHITECTURE; MODERN TECHNOLOGIES; OPERATIONAL MODEL; SOCIAL ACTIVITIES;

BIG DATA;

EID: 84906250101     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CTS.2014.6867550     Document Type: Conference Paper

References (45)

1. Global Research Data Infrastructures: Towards a 10-year vision for global research data infrastructures. Final Roadmap, March 2012. [Online]. Available: http://www.grdi2020.eu/Repository/FileScaricati/6bdc07fb-b21d-4b90-81d4- d909fdb96b87.pdf
2. Riding the wave: How Europe can gain from the rising tide of scientific data. Final report of the High Level Expert Group on Scientific Data. October 2010. [Online]. Available at http://cordis.europa.eu/fp7/ict/e-infrastructure/ docs/hlg-sdi-report.pdf
3. Y.Demchenko, P.Membrey, P.Grosso, C. de Laat, "Addressing Big Data Issues in Scientific Data Infrastructure," in First International Symposium on Big Data and Data Analytics in Collaboration (BDDAC 2013). Part of The 2013 Int. Conf. on Collaboration Technologies and Systems (CTS 2013), May 20-24, 2013, San Diego, California, USA.
4. NIST Big Data Working Group (NBD-WG). [Online]. Available: http://bigdatawg.nist.gov/home.php
5. Definting Big Data Architetcure Framework: Outcome of the Brainstorming Session at the University of Amsterdam, 17 July 2013. Presented at NBD-WG, 24 July 2013 [Online]. Available: http://bigdatawg.nist.gov/-uploadfiles/M0055-v1- 7606723276.pdf
6. Reflections on Big Data, Data Science and Related Subjects. Blog by Irving Wladawsky-Berger. [online] Available http://blog.irvingwb.com/blog/2013/ 01/reflections-on-big-data-data-science-And-related-subjects.html
7. E.Dumbill, What is big data? An introduction to the big data landscape. [Online]. Available: http://strata.oreilly.com/2012/01/what-is-big-data.html
8. The Big Data Long Tail. Blog post by Jason Bloomberg, January 17, 2013. [Online]. Available: http://www.devx.com/blog/the-big-data-long-tail.html
9. J.Gantz and David Reinsel, Extracting Value from Chaos, IDC IVIEW, June 2011. [Online]. Available: http://www.emc.com/collateral/analyst-reports/idc- extracting-value-from-chaos-Ar.pdf
10. The Fourth Paradigm: Data-Intensive Scientific Discovery. Edited by Tony Hey, Stewart Tansley, and Kristin Tolle. Microsoft Corporation, October 2009. ISBN 978-0-9825442-0-4 [Online]. Available: http://research.microsoft.com/en-us/ collaboration/fourthparadigm/
11. Big Data defintion, Gartner, Inc. [Online]. Available: http://www.gartner.com/it-glossary/big-data/
12. S.Sicular, "Gartner's Big Data Definition Consists of Three Parts, Not to Be Confused with Three "V"s", Gartner, Inc. 27 March 2013. [Online]. Available: http://www.forbes.com/sites/gartnergroup/2013/03/27/ gartners-big-data-definition-consists-of-Three-parts-not-to-be-confused-with- Three-vs/
13. J.Layton, "The Top of the Big Data Stack: Database Applications", July 27, 2012. [Online]. Available: http://www. enterprisestorageforum.com/storage-management/the-top-of-The-big-data-stack- database-Applications.html
14. Explore big data analytics and Hadoop. [Online]. Available: http://www.ibm.com/developerworks/training/kp/os-kp-hadoop/
15. A.Bloom, 7 Myths on Big Data: Avoiding Bad Hadoop and Cloud Analytics Decisions, April 22, 2013. [Online]. Available: http://blogs.vmware.com/vfabric/ 2013/04/myths-About-running-hadoop-in-A-virtualized-environment.html
16. European Union. A Study on Authentication and Authorisation Platforms For Scientific Resources in Europe. Brussels: European Commission, 2012. Final Report. Contributing author. Internal identification SMART-Nr 2011/0056. [Online]. Available: Available at http://cordis.europa.eu/fp7/ict/e- infrastructure/docs/aaa-study-final-report.pdf
17. Y.Demchenko P.Membrey, C.Ngo, C. de Laat, D.Gordijenko., Big Security for Big Data: Addressing Security Challenges for the Big Data Infrastructure, Proc. Secure Data Management (SDM'13) Workshop. Part of VLDB2013 conference, 26-30 August 213, Trento, Italy
18. NIST SP 500-292, Cloud Computing Reference Architecture, v1.0. [Online]. Available: http://collaborate.nist.gov/twiki-cloud-computing/pub/CloudComputing/ ReferenceArchitectureTaxonomy/NIST-SP-500-292--090611.pdf
19. Y.Demchenko, M. Makkes, R.Strijkers, C.Ngo, C. de Laat, Intercloud Architecture Framework for Heterogeneous Multi-Provider Cloud based Infrastructure Services Provisioning, The International Journal of Next-Generation Computing (IJNGC), Volume 4, Issue 2, July 2013
20. NIST Big Data Reference Architecture. NBD-WG, NIST [Online]. Available: http://bigdatawg.nist.gov/-uploadfiles/M0226-v10-1554566513.docx
21. NIST Big Data Technology Roadmap. NBD-WG [Online]. Available: http://bigdatawg.nist.gov/-uploadfiles/M0087-v8-1456721868.docx
22. Open Data Center Alliance Master Usage model: Information as a Service, Rev 1.0. [Online]. Available: http://www.opendatacenteralliance.org/docs/ Information-as-a-Service-Master-Usage-Model-Rev1.0.pdf
23. TR202 Big Data Analytics Reference Model. TMF Document, Version 1.9, April 2013.
24. IBM GBS Business Analytics and Optimisation (2011). IBM, 2013. [Online]. Available: https://www.ibm.com/developerworks/ mydeveloperworks/ files/basic/anonymous/api/library/48d92427-47d3-4e75-b54c-b6acfbd608c0/document/ aa78f77c-0d57-4f41-A923-50e5c6374b6d/media&ei=yrknUbjMNM- liwKQhoCQBQ&usg=AFQjCNF-Xu6aifcAhlF4266xXNhKfKaTLw&sig2= j8JiFV-md5DnzfQl0spVrg&bvm=bv.42768644,d.cGE
25. A.M.Middleton, HPCC Systems: Introduction to HPCC (High Performance Computer Cluster), LexisNexis Risk Solutions, LexiNexis, May 24, 2011
26. Bierauge, M., Keeping Up With. Big Data. American Library Association, 2013 [Online]. Available: http://www.ala.org/acrl/publications/keeping-up-with/ big-data
27. Unstructured Data Management, Hitachi Data System, 2013. [online] http://www.hds.com/solutions/it-strategies/unstructured-data-management.html
28. NIST Big Data WG discussion [Online]. Available: http://bigdatawg.nist. gov/home.php
29. D.Koopa, et al, "A Provenance-Based Infrastructure to Support the Life Cycle of Executable Papers", in International Conference on Computational Science, ICCS 2011. "[Online]. Available: http://vgc.poly.edu/~juliana/pub/vistrails-executable-paper.pdf
30. Open Access: Opportunities and Challenges. European Commission for UNESCO. [Online]. Available: http://ec.europa.eu/research/science-society/ document-library/pdf-06/open-Access-handbook-en.pdf
31. OpenAIR-Open Access Infrastructure for Research in Europe. [Online]. Available: http://www.openaire.eu/
32. Open Researcher and Contributor ID. [online] http://about.orcid.org/
33. Roundup of Big Data Pundits' Predictions for 2013. Blog post by David Pittman. January 18, 2013. [Online]. Available:http://www.ibmbigdatahub.com/ blog/roundup-big-data-pundits-predictions-2013
34. The Forrester Wave: Big Data Predictive Analytics Solutions, Q1 2013. Mike Gualtieri, January 13, 2013. [Online]. Available: http://www.forrester.com/ pimages/rws/reprints/document/85601/oid/1-LTEQDI
35. Big data: The next frontier for innovation, competition, and productivity, May 2011. McKinsey Global Institute. [Online]. Available: http://www.mckinsey.com/insights/business-technology/big-data-the-next-frontier- for-innovation
36. Data Lifecycle Models and Concepts. [Online]. Available: http://wgiss.ceos.org/dsig/whitepapers/ Data%20Lifecycle%20Models%20and%20Concepts%20v8.docx
37. M.Makkes, C.Ngo, Y.Demchenko, R.Strijkers, R.Meijer, C. de Laat, "Defining Intercloud Federation Framework for Multi-provider Cloud Services Integration", in The Fourth International Conference on Cloud Computing, GRIDs, and Virtualization (CLOUD COMPUTING 2013), May 27-June 1, 2013,Valencia, Spain.
38. M.Turk, A chart of the big data ecosystem, take 2. [online] http://mattturck.com/2012/10/15/a-chart-of-The-big-data-ecosystem-take-2/
39. Amazon Big Data. [Online]. Available: http://aws.amazon.com/big-data/
40. Microsoft Azure Big Data. Microsoft, 2013 [Online]. Available: http://www.windowsazure.com/en-us/home/scenarios/big-data/
41. IBM Big Data Analytics. IBM, 2o13 [Online]. Available: http://www-01.ibm.com/software/data/infosphere/bigdata-Analytics.html
42. Cloudera Impala Big Data Platform [Online]. Available: http://www.cloudera.com/content/cloudera/en/home.html
43. 10 hot big data startups to watch in 2013, 10 January 2013 [Online]. Available: http://beautifuldata.net/2013/01/10-hot-big-data-startups-to-watch- in-2013/
44. P.Membrey, K.C.C. Chan, Y.Demchenko, A Disk Based Stream Oriented Approach For Storing Big Data. In First International Symposium on Big Data and Data Analytics in Collaboration (BDDAC 2013). Part of The 2013 International Conference on Collaboration Technologies and Systems (CTS 2013), May 20-24, 2013, San Diego, California, USA.
45. Research Data Alliance (RDA). [Online]. Available: http://rd-Alliance. org/