Emerging trends and technologies in big data processing

Concurrency and Computation: Practice and Experience

Volumn 27, Issue 8, 2015, Pages 2078-2091

  Casado, Rubén ^a   Younas, Muhammad ^b  

^a Department of Research and Innovation ^*  (Spain)

^b OXFORD BROOKES UNIVERSITY   (United Kingdom)

Author keywords

Big Data; NoSQL; processing paradigms

Indexed keywords

BIG DATA; DATA ACQUISITION; DECISION MAKING; DIGITAL STORAGE; LIFE CYCLE;

BUSINESS ANALYSIS; CONVENTIONAL DATABASE; CUSTOMER EXPERIENCE; EMERGING TRENDS; NOSQL; PROCESSING CAPABILITY; TOOLS AND TECHNOLOGIES; UNSTRUCTURED DATA;

DATA HANDLING;

EID: 84928142933     PISSN: 15320626     EISSN: 15320634     Source Type: Journal    
DOI: 10.1002/cpe.3398     Document Type: Article

References (55)

1. Paper AGW,. 'Big Data:' big challenge, big opportunity; 1-6.
2. O'Reilly Media I,. Big Data Now: 2012 Edition. O'Reilly Media: Sebastopol, CA, 2012.
3. Taube BB, Solutions SG, Corporation V,. Leveraging Big Data and real-time analytics to achieve situational awareness for smart grids; 1-20.
4. Jacobs A,. The pathologies of Big Data. Communications of the ACM 2009; 52 (8): 36.
5. Casado R,. The three generations of Big Data processing. In Big Data Spain, 2013.
6. Ghemawat S, Gobioff H, Leung S-T,. The Google file system. ACM SIGOPS Operating Systems Review 2003; 37 (5): 29.
7. Dean J, Ghemawat S,. MapReduce: simplified data processing on large clusters. Communications of the ACM 2008; 51 (1): 137-150.
8. Apache. Apache Hadoop. 2008. [Online]. Available: http://hadoop.apache.org /.
9. Yahoo!. S4: distributed stream computing platform, 2010. [Online]. Available: http://incubator.apache.org/s4/. [Accessed: 01-Feb-2014].
10. Linkedin. Samza, 2013. [Online]. Available: http://samza.incubator.apache.org /. [Accessed: 01-Feb-2014].
11. Akidau T, Balikov A, Bekiroʇlu K, Chernyak S, Haberman J, Lax R, McVeety S, Mills D, Nordstrom P, Whittle S,. MillWheel: fault-tolerant stream processing at internet scale. Proceedings of the VLDB Endowment 2013; 6 (11): 1033-1044.
12. Marz N, Warren J,. Big Data Principles and Best Practices of Scalable Realtime Data Systems. Manning Publications Co.: Shelter Island, NY, 2014; 425.
13. White T,. Hadoop: The Definitive Guide. Sebastopol, CA, 2009.
14. Yah. Apache Pig, 2008. [Online]. Available: http://pig.apache.org /. [Accessed: 11-Jun-2013].
15. Facebook. Apache Hive, 2009. [Online]. Available: http://hive.apache.org /. [Accessed: 11-Jun-2013].
16. Storm, distributed and fault-tolerant realtime computation. [Online]. Available: http://storm-project.net /. [Accessed: 10-Jun- 2013 ].
17. Cloudera. Apache Flume, 2011. [Online]. Available: http://flume.apache.org /. [Accessed: 10-Jun-2013].
18. Linkedin. Apache Kafka, a high-throughput distributed messaging system, 2011. [Online]. Available: https://kafka.apache.org /. [Accessed: 01-Feb-2014].
19. Corporation SI,. Survey on NoSQL database. Pervasive Comput., no. 61072060, 2011; 363-366.
20. Decandia G, Hastorun D, Jampani M, Kakulapati G, Lakshman A, Pilchin A, Sivasubramanian S, Vosshall P, Vogels W,. Dynamo: Amazon's highly available key-value store, 2007; 205-220.
21. Chang F, Dean J, Ghemawat S, Hsieh WC, Wallach DA, Burrows M, Chandra T, Fikes A, Gruber RE,. Bigtable. ACM Transactions on Computer Systems 2008; 26 (2): 1-26.
22. Melnik S, Gubarev A, Long JJ, Romer G, Shivakumar S, Tolton M, Vassilakis T,. Dremel: interactive analysis of web-scale datasets. Proceedings of the VLDB Endowment 2010; 3 (1-2): 330-339.
23. Apache Drill. [Online]. Available: https://incubator.apache.org/drill/. [Accessed: 01-Feb- 2014 ].
24. Cattell R,. Scalable SQL and NoSQL data stores. ACM SIGMOD Record 2011; 39 (4): 12.
25. Pritchett D,. BASE: an ACID alternative. Queue 2008; 6 (3): 48-55.
26. Jatana N, Puri S, Ahuja M, Kathuria I, Gosain D,. A survey and comparison of relational and non-relational database. International Journal of Engineering Research and Technology 2012; 1 (6): 1-5. ISSN 2278-0181
27. Apache HBase. [Online]. Available: http://hbase.apache.org /. [Accessed: 10-Jun- 2013 ].
28. Sanfilippo S,. Redis. 2009. [Online]. Available: http://redis.io /. [Accessed: 01-Feb-2014].
29. Chodorow K, Dirolf M,. MongoDB: The Definitive Guide, O'Reilly Media, Inc.: Sebastopol, CA, vol. 203, 2011, p. NP.
30. Katz D,. Apache CouchDB, 2005. [Online]. Available: http://couchdb.apache.org /. [Accessed: 01-Feb-2014].
31. Neo Technology. Neo4j-the world's leading graph database, 2010. [Online]. Available: http://www.neo4j.org /. [Accessed: 01-Feb-2014].
32. Yahoo!. Apache Giraph, 2011. [Online]. Available: http://giraph.apache.org /. [Accessed: 01-Feb-2014].
33. Malewicz G, Austern MH, Bik AJ, Dehnert JC, Horn I, Leiser N, Czajkowski G,. Pregel. In Proceedings of the 2010 international conference on Management of data-SIGMOD '10, 2010; 135.
34. Abadi DJ, Boncz PA, Harizopoulos S,. Column-oriented database systems. Proceedings of the VLDB Endowment 2009; 2 (2): 1664-1665.
35. Lakshman A,., Malik P,. The Apache Cassandra Project, 2011. [Online]. Available: http://cassandra.apache.org /. [Accessed: 01-Feb-2014].
36. Zvents. Hypertable-Big Data. Big Performance, 2008. [Online]. Available: http://hypertable.org /. [Accessed: 01-Feb-2014].
37. Cloudera. Apache Sqoop, 2009. [Online]. Available: http://sqoop.apache.org /.
38. Facebook. Scribe, 2008. [Online]. Available: https://github.com/facebook/scribe.
39. Wensel C,. Cascading | Application Platform for Enterprise Big Data, 2008. [Online]. Available: http://www.cascading.org /. [Accessed: 01-Feb-2014].
40. AMPLab. Apache Spark-lightning-fast cluster computing, 2012. [Online]. Available: http://spark.incubator.apache.org /. [Accessed: 01-Feb-2014].
41. Zaharia M, Chowdhury M, Das T, Dave A, Ma J, McCauley M, Franklin MJ, Shenker S, Stoica I,. Resilient distributed datasets: a fault-tolerant abstraction for in-memory cluster computing, 2012; 2.
42. AMPLab. Shark, 2013. [Online]. Available: https://github.com/amplab/shark/wiki.
43. Pointer R,. Kestrel, 2008. [Online]. Available: https://github.com/twitter/kestrel.
44. Treelogic. Lambdoop, 2013. [Online]. Available: http://www.lambdoop.com /.
45. Casado R,. Lambdoop, a framework for easy development of Big Data applications. In NoSQL Matters Barcelona, 2013.
46. Twitter. Summingbird, 2013. [Online]. Available: http://www.infoq.com/news/2014/01/twitter-summingbird.
47. Neumeyer L, Robbins B, Nair A, Kesari A,. S4: distributed stream computing platform. In 2010 IEEE International Conference on Data Mining Workshops, 2010; 170-177.
48. Melnik S, Gubarev A, Long JJ, Romer G, Shivakumar S, Tolton M, Vassilakis T,. Dremel. Communications of the ACM 2011; 54 (6): 114.
49. Krukowski A, Kompatsiaris Y, Rodero Merino L, Nikolopoulos S, Hanat F, Echchihab N, Morik K, Casado R, Gomez R, Bento C, Köhler J, Audsin D, Raimond Y, Bower A, Holken H, Brandtzæg P, van Tol E, Sturm J, Jacobs R, Meunier J-D, Adzic J,. Big and Open data position paper, 2013.
50. Boyd D, Crawford K,. Critical questions for Big Data. Information, Communication & Society 2012; 15: 662-679.
51. Agrawal D, Das S, El Abbadi A,. Big Data and Cloud Computing: current state and future opportunities, 2011; 0-3.
52. Version D,. Critical questions for Big Data: provocations for a cultural, technological, and scholarly phenomenon. no. 2012, 2005; 662-679.
53. Bollier D,. The promise and peril of Big Data. Aspen Institute, Communications and Society Program: Washington, DC, 2010; 1-66.
54. Zhou M, States U, Grimmer J, King G, Science QS,. The Age of Big Data. The New York Times: New York, 2012.
55. Boyd D, Crawford K,. Six provocations for Big Data. Computer (Long. Beach. Calif) 2011; 123 (1): 1-17.