A survey on platforms for big data analytics

Journal of Big Data

Volumn 2, Issue 1, 2015, Pages

  Singh, Dilpreet ^a   Reddy, Chandan K ^a  

^a Wayne State University   (United States)

Author keywords

Big data; big data analytics; big data platforms; graphics processing units; k means clustering; MapReduce; real time processing; scalability

Indexed keywords

CLUSTERING ALGORITHMS; COMPUTER GRAPHICS; FAULT TOLERANCE; GRAPHICS PROCESSING UNIT; ITERATIVE METHODS; PROGRAM PROCESSORS; SCALABILITY;

BIG DATA ANALYTIC; BIG DATA PLATFORM; DATA ANALYTICS; DATA PLATFORM; HARDWARE PLATFORM; IN-DEPTH ANALYSIS; K-MEANS++ CLUSTERING; MAP-REDUCE; PAPER SURVEYS; REALTIME PROCESSING;

MAPREDUCE;

EID: 85013916411     PISSN: None     EISSN: 21961115     Source Type: Journal    
DOI: 10.1186/s40537-014-0008-6     Document Type: Article

References (44)

1. Agneeswaran VS, Tonpay P, Tiwary J: Paradigms for realizing machine learning algorithms. Big Data 2013,1(4):207–214. 10.1089/big.2013.0006
2. Zaharia M, Chowdhury M, Franklin MJ, Shenker S, Spark SI: Cluster Computing with Working Sets. Proceedings of the 2nd USENIX Conference on Hot Topics in Cloud Computing 2010, 10–10.
3. Milojicic DS, Kalogeraki V, Lukose R, Nagaraja K, Pruyne J, Richard B, Rollins S, Xu Z: Peer-to-peer computing. Technical Report HPL-2002–57, HP Labs. 2002.
4. Steinmetz R, Wehrle K: Peer-to-Peer Systems and Applications. Springer Berlin, Heidelberg; 2005.
5. Sievert O, Casanova H: A simple MPI process swapping architecture for iterative applications. Int J High Perform Comput Appl 2004,18(3):341–352. 10.1177/1094342004047430
6. Hadoop., [http://hadoop.apache.org/]
7. Borthakur D: HDFS architecture guide. HADOOP APACHE PROJECT. 2008.
8. Vavilapalli VK, Murthy AC, Douglas C, Agarwal S, Konar M, Evans R, Graves T, Lowe J, Shah H, Seth S: Apache hadoop yarn: Yet another resource negotiator. Proceedings of the 4th annual Symposium on Cloud Computing 2013, 5.
9. Dean J, Ghemawat S: MapReduce: simplified data processing on large clusters. Commun ACM 2008,51(1):107–113. 10.1145/1327452.1327492
10. Lee K-H, Lee Y-J, Choi H, Chung YD, Moon B: Parallel data processing with MapReduce: a survey. ACM SIGMOD Record 2012,40(4):11–20. 10.1145/2094114.2094118
11. Olston C, Reed B, Srivastava U, Kumar R, Tomkins A: Pig latin: a not-so-foreign language for data processing. In Proceedings of the ACM SIGMOD international conference on Management of Data. ACM, ᅟ; 2008:1099–1110.
12. Thusoo A, Sarma JS, Jain N, Shao Z, Chakka P, Anthony S, Liu H, Wyckoff P, Murthy R: Hive: a warehousing solution over a map-reduce framework. Proceedings of the VLDB Endowment 2009,2(2):1626–1629. 10.14778/1687553.1687609
13. Yu Y, Isard M, Fetterly D, Budiu M, Erlingsson Ú, Gunda PK, Currey J: DryadLINQ: A System for General-Purpose Distributed Data-Parallel Computing Using a High-Level Language. OSDI 2008, 1–14.
14. Owen S, Anil R, Dunning T, Friedman E: Mahout in Action. Manning. 2011.
15. Bu Y, Howe B, Balazinska M, Ernst MD: HaLoop: efficient iterative data processing on large clusters. Proceedings of the VLDB Endowment 2010,3(1–2):285–296. 10.14778/1920841.1920881
16. Ekanayake J, Pallickara S, Fox G: Mapreduce for data intensive scientific analyses. Proceesings of IEEE Fourth International Conference on eScience 2008, 277–284.
17. Palit I, Reddy CK: Scalable and parallel boosting with MapReduce. IEEE Trans Knowl Data Eng 2012,24(10):1904–1916. 10.1109/TKDE.2011.208
18. Ekanayake J, Li H, Zhang B, Gunarathne T, Bae S-H, Qiu J, Fox G (2010) Twister: a runtime for iterative mapreduce. In: Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing. ACM, pp 810–818
19. Zhang Y, Gao Q, Gao L, Wang C: Imapreduce: a distributed computing framework for iterative computation. J Grid Comput 2012,10(1):47–68. 10.1007/s10723-012-9204-9
20. Berkeley Data Analysis Stack., [https://amplab.cs.berkeley.edu/software/]
21. Tachyon., [http://tachyon-project.org/]
22. Aurora., [https://incubator.apache.org/projects/aurora.html]
23. Agarwal S, Mozafari B, Panda A, Milner H, Madden S, Stoica I: BlinkDB: Queries with Bounded Errors and Bounded Response times on very Large Data. Proceedings of the 8th ACM European Conference on Computer Systems 2013, 29–42. 10.1145/2465351.2465355
24. Xin RS, Gonzalez JE, Franklin MJ, Stoica I: Graphx: A resilient distributed graph system on spark. First International Workshop on Graph Data Management Experiences and Systems 2013, 2.
25. Kraska T, Talwalkar A, Duchi JC, Griffith R, Franklin MJ, Jordan MI: MLbase: A Distributed Machine-learning System. Proceedings of Sixth Biennial Conference on Innovative Data Systems Research 2013.
26. Amazon Elastic MapReduce, [http://aws.amazon.com/]
27. Buyya R: High Performance Cluster Computing: Architectures and Systems (Volume 1). Prentice Hall, Upper SaddleRiver, NJ, USA; 1999.
28. Bekkerman R, Bilenko M, Langford J (2012) Scaling up Machine Learning: Parallel and Distributed Approaches. Cambridge University Press
29. Tullsen DM, Eggers SJ, Levy HM: Simultaneous Multithreading: Maximizing on-Chip Parallelism. ACM SIGARCH Computer Architecture News 1995, 392–403.
30. Owens JD, Houston M, Luebke D, Green S, Stone JE, Phillips JC: GPU computing. Proc IEEE 2008,96(5):879–899. 10.1109/JPROC.2008.917757
31. Nickolls J, Dally WJ: The GPU computing era. IEEE Micro 2010,30(2):56–69. 10.1109/MM.2010.41
32. Hong S, Kim H: An analytical Model for a GPU Architecture with Memory-Level and Thread-Level Parallelism Awareness. ACM SIGARCH Computer Architecture News 2009, 152–163.
33. Fang W, Lau KK, Lu M, Xiao X, Lam CK, Yang PY, He B, Luo Q, Sander PV, Yang K: Parallel data mining on graphics processors. Hong Kong University of Science and Technology, Tech Rep HKUST-CS08–07 2. 2008.
34. Francis RJ, Rose J, Vranesic ZG (1992) Field Programmable Gate Arrays, vol 180. Springer
35. Thomas DE, Moorby PR (2002) The Verilog Hardware Description Language, vol 2. Springer
36. Monmasson E, Idkhajine L, Cirstea MN, Bahri I, Tisan A, Naouar MW: FPGAs in industrial control applications. IEEE Trans Ind Informat 2011,7(2):224–243. 10.1109/TII.2011.2123908
37. Bouldin D: Impacting education using FPGAs. Proceedings of 18th International conference on Parallel and Distributed Processing Symposium 2004, 142.
38. Chen H, Chen Y, Summerville DH: A survey on the application of FPGAs for network infrastructure security. IEEE Commun Surv Tutor 2011,13(4):541–561. 10.1109/SURV.2011.072210.00075
39. Jedhe GS, Ramamoorthy A, Varghese K: A scalable high throughput firewall in FPGA. Proceedings of 16th International Symposium on Field-Programmable Custom Computing Machines 2008, 43–52.
40. Fault Tolerance., [http://en.wikipedia.org/wiki/Fault_tolerance]
41. Snir M (1998) MPI–the Complete Reference: The MPI core, vol 1. MIT press
42. Jain AK: Data clustering: 50 years beyond K-means. Pattern Recogn Lett 2010,31(8):651–666. 10.1016/j.patrec.2009.09.011
43. Reddy CK, Vinzamuri B: A Survey of Partitional and Hierarchical Clustering Algorithms. Data Clustering: Algorithms and Applications. 2013.
44. Gropp W, Lusk E, Skjellum A (1999) Using MPI: Portable Parallel Programming with the Message-Passing Interface, Vol 1. MIT press