Toward scalable systems for big data analytics: A technology tutorial

IEEE Access

Volumn 2, Issue , 2014, Pages 652-687

  Hu, Han ^a,b   Wen, Yonggang ^a,c   Chua, Tat Seng ^a,b   Li, Xuelong ^a,d  

^a IEEE   (United States)

^b NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

^c NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

^d XI AN INSTITUTE OF OPTICS AND PRECISION MECHANICS   (China)

Author keywords

Big data analytics; Cloud computing; Data acquisition; Data analytics; Data storage; Hadoop

Indexed keywords

CHAINS; CLOUD COMPUTING; DATA ACQUISITION; DATA HANDLING; DIGITAL STORAGE; DISTRIBUTED COMPUTER SYSTEMS; INDUSTRIAL RESEARCH; SUPPLY CHAINS; SURVEYS;

DATA ANALYTICS; DATA STORAGE; HADOOP; LARGE-SCALE DATA PROCESSING; POTENTIAL RESEARCHES; SYSTEM ARCHITECTURES; SYSTEMATIC FRAMEWORK; TECHNOLOGICAL ADVANCEMENT;

BIG DATA;

EID: 84923224316     PISSN: None     EISSN: 21693536     Source Type: Journal    
DOI: 10.1109/ACCESS.2014.2332453     Document Type: Article

References (290)

1. J. Gantz and D. Reinsel, "The digital universe in 2020: Big data, bigger digital shadows, and biggest growth in the far east," in Proc. IDC iView, IDC Anal Future, 2012.
2. J. Manyika et al., Big data: The Next Frontier for Innovation, Competition, and Productivity. San Francisco, CA, USA: McKinsey Global Institute, 2011, pp. 1-137.
3. K. Cukier, "Data, data everywhere," Economist, Vol. 394, no. 8671, pp. 3-16, 2010.
4. T. economist. (2011, Nov.) Drowning in Numbers - Digital Data Will Flood the Planet- and Help us Understand it Better [Online], Available: http://www.economist.com/blogs/dailychart/2011/11/bigdata-0
5. S. Lohr. (2012). The age of big data. New York Times [Online], 11. Available: http://www.nytimes.com/2012/02/12/sunday-review/big-datas-impact-in-the-orld.html?pagewanted=all&r=0
6. Y. Noguchi. (2011, Nov.). Following Digital Breadcrumbs to Big Data Gold, National Public Radio, Washington, DC, USA [Online], Available: http://www.npr.org/2011/ll/29/142521910/the-digitalbreadcrumbs-that-lead-to-big-data
7. Y. Noguchi. (2011, Nov.). The Search for Analysts to Make Sense of Big Data, National Public Radio, Washington, DC, USA [Online], Available: http://www.npr.org/2011/11/30/142893065/the-search-foranalysts-to-make-%sense-of-big-data
8. W. House. (2012, Mar.). Fact Sheet: Big Data Across the Federal Government [Online]. Available: http://www.whitehouse.gov/sites/default/files/microsites/ostp/big-data%-fact-sheet-3-29-2012.pdf
9. J. Kelly. (2013). Taming Big Data [Online], Available: http://wikibon.org/blog/taming-big-data/
10. Wiki. (2013). Applications and Organizations Using Hadoop [Online], Available: http://wiki.apache.org/hadoop/PoweredBy
11. J. H. Howard et al, "Scale and performance in a distributed file system," ACM Trans. Comput. Syst., Vol. 6, no. 1, pp. 51-81, 1988.
12. R. Cattell, "Scalable SQL and NoSQL data stores," SIGMOD Rec., Vol. 39, no. 4, pp. 12-27, 2011.
13. J. Dean and S. Ghemawat, "Mapreduce: Simplified data processing on large clusters," Commun. ACM, Vol. 51, no. 1, pp. 107-113, 2008.
14. T. White, Hadoop: The Definitive Guide. Sebastopol, CA, USA: O'Reilly Media, 2012.
15. J. Gantz and D. Reinsel, "Extracting value from chaos," in Proc. IDC iView, 2011, pp. 1-12.
16. P. Zikopoulos and C. Eaton, Understanding Big Data: Analytics for Enterprise Class Hadoop and Streaming Data. New York, NY, USA: McGraw-Hill, 2011.
17. E. Meijer, "The world according to LINQ," Commun. ACM, Vol. 54, no. 10, pp. 45-51, Aug. 2011.
18. D. Laney, "3d data management: Controlling data volume, velocity and variety," Gartner, Stamford, CT, USA, White Paper, 2001.
19. M. Cooper and P. Mell. (2012). Tackling Big Data [Online], Available: http://csrc.nist.gov/groups/SMA/forum/documents/june2012presentations/f%csm-june2012-cooper-mell.pdf
20. O. R. Team, Big Data Now: Current Perspectives from O'Reilly Radar. Sebastopol, CA, USA: O'Reilly Media, 2011.
21. M. Grobelnik. (2012, Jul.). Big Data Tutorial [Online], Available: http://videolectures.net/eswc2012-grobelnik-big-data/
22. S. Marche, "Is Facebook making us lonely," Atlantic, Vol. 309, no. 4, pp. 60-69, 2012.
23. V. R. Borkar, M. J. Carey, and C. Li, "Big data platforms: What's next?" XRDS, Crossroads, ACM Mag. Students, Vol. 19, no. 1, pp. 44-49, 2012.
24. V. Borkar, M. J. Carey, and C. Li, "Inside big data management: Ogres, onions, or parfaits?" in Proc. 15th Int. Conf. Extending Database Technol., 2012, pp. 3-14.
25. D. Dewitt and J. Gray, "Parallel database systems: The future of high performance database systems," Commun. ACM, Vol. 35, no. 6, pp. 85-98, 1992.
26. (2014). Teradata. Teradata, Dayton, OH, USA [Online], Available: http://www.teradata.com/
27. (2013). Netezza. Netezza, Marlborough, MA, USA [Online], Available: http://www-01.ibm.com/software/data/netezza
28. (2013). Aster Data. ADATA, Beijing, China [Online], Available: http://www.asterdata.com/
29. (2013). Greenplum. Greenplum, San Mateo, CA, USA [Online], Available: http://www.greenplum.com/
30. (2013). Vertica [Online], Available: http://www.vertica.com/
31. S. Ghemawat, H. Gobioff, and S.-T. Leung, "The Google file system," in Proc. 19th ACM Symp. Operating Syst. Principles, 2003, pp. 29-43.
32. T. Hey, S. Tansley, and K. Tolle, The Fourth Paradigm: Data-Intensive Scientific Discovery. Cambridge, MA, USA: Microsoft Res., 2009.
33. B. Franks, Taming the Big Data Tidal Wave: Finding Opportunities in Huge Data Streams With Advanced Analytics, Vol. 56. New York, NY, USA: Wiley, 2012.
34. N. Tatbul, "Streaming data integration: Challenges and opportunities," in Proc. IEEE 26th Int. Conf. Data Eng. Workshops (ICDEW), Mar. 2010, pp. 155-158.
35. (2013). Storm [Online], Available: http://storm-project.net/
36. L. Neumeyer, B. Robbins, A. Nair, and A. Kesari, "S4: Distributed stream computing platform," in Proc. IEEE Int. Conf. Data Mining Workshops (ICDMW), Dec. 2010, pp. 170-177.
37. K. Goodhope et al., "Building linkedins real-time activity data pipeline," Data Eng., Vol. 35, no. 2, pp. 33-45, 2012.
38. E. B. S. D. D. Agrawal et al., "Challenges and opportunities with big data - A community white paper developed by leading researchers across the united states," The Computing Research Association, CRA White Paper, Feb. 2012.
39. D. Fisher, R. DeLine, M. Czerwinski, and S. Drucker, "Interactions with big data analytics," Interactions, Vol. 19, no. 3, pp. 50-59, May 2012.
40. F. Gallagher. (2013). The Big Data Value Chain [Online], Available: http://fraysen.blogspot.sg/2012/06/big-data-value-chain.html
41. M. Sevilla. (2012). Big Data Vendors and Technologies, the list.' [Online], Available: http://www.capgemini.com/blog/capping-it-off/2012/09/big-data-vendors-a%nd-technologies-the-list
42. M. Isard, M. Budhi, Y Yu, A. Birrell, and D. Fetterly, "Dryad: Distributed data-parallel programs from sequential building blocks," in Proc. 2nd ACM SIGOPS/EuroSys Eur. Conf. Comput. Syst., Jun. 2007, pp. 59-72.
43. G. Malewicz et al., "Pregel: A system for large-scale graph processing," in Proc. ACM SIGMOD Int. Conf. Manag. Data, Jun. 2010, pp. 135-146.
44. S. Melnik et al., "Dremel: Interactive analysis of web-scale datasets," Proc. VLDB Endowment, Vol. 3, nos. 1-2, pp. 330-339, 2010.
45. A. Labrinidis and H. V. Jagadish, "Challenges and opportunities with big data," Proc. VLDB Endowment, Vol. 5, no. 12, pp. 2032-2033, Aug. 2012.
46. S. Chaudhuri, U. Dayal, and V. Narasayya, "An overview of business intelligence technology," Commun. ACM, Vol. 54, no. 8, pp. 88-98, 2011.
47. (2013). What is Big Data, IBM, New York, NY, USA [Online]. Available: http://www-01.ibm.com/software/data/bigdata/
48. D. Evans and R. Hutley, "The explosion of data," white paper, 2010.
49. knowwpc. (2013). eBay Study: How to Build Trust and Improve the Shopping Experience [Online]. Available: http://knowwpcarey.com/article.cfm?aid=1171
50. J. Gantz and D. Reinsel, "The digital universe decade-are you ready," in Proc. White Paper, IDC, 2010.
51. J. Layton. (2013). How Amazon Works [Online]. Available: http://knowwpcarey.com/article.cfm?aid=1171
52. Wikibon. (2013). A Comprehensive List of Big Data Statistics [Online]. Available: http://wikibon.org/blog/big-data-statistics/
53. R. E. Bryant, "Data-intensive scalable computing for scientific applications," Comput. Sci. Eng., Vol. 13, no. 6, pp. 25-33, 2011.
54. (2013). SDSS [Online]. Available: http://www.sdss.org/
55. (2013). Atlas [Online]. Available: http://http://atlasexperiment.org/
56. X. Wang, "Semantically-aware data discovery and placement in collaborative computing environments," Ph.D. dissertation, Dept. Comput. Sci., Taiyuan Univ. Technol., Shanxi, China, 2012.
57. S. E. Middleton, Z. A. Sabeur, P. Löwe, M. Hammitzsch, S. Tavakoli, and S. Poslad, "Multi-disciplinary approaches to intelligently sharing large-volumes of real-time sensor data during natural disasters," Data Sci. J., Vol. 12, pp. WDS109-WDS113, 2013.
58. J. K. Laurila et al, "The mobile data challenge: Big data for mobile computing research," in Proc. 10th Int. Conf. Pervas. Comput. Workshop Nokia Mobile Data Challenge, Conjunct., 2012, pp. 1-8.
59. V. Chandramohan and K. Christensen, "A first look at wired sensor networks for video surveillance systems," in Proc. 27th Annu. IEEE Conf. Local Comput. Netw. (LCN), Nov. 2002, pp. 728-729.
60. L. Selavo et al., "Luster: Wireless sensor network for environmental research," in Proc. 5th Int. Conf. Embedded Netw. Sensor Syst., Nov. 2007, pp. 103-116.
61. G. Barrenetxea, F. Ingelrest, G. Schaefer, M. Vetterli, O. Couach, and M. Parlange, "Sensorscope: Out-of-the-box environmental monitoring," in Proc. IEEE Int. Conf. Inf. Process. Sensor Netw. (IPSN), 2008, pp. 332-343.
62. Y. Kim, T. Schmid, Z. M. Charbiwala, J. Friedman, and M. B. Srivastava, "Nawms: Nonintrusive autonomous water monitoring system," in Proc. 6th ACM Conf. Embedded Netw. Sensor Syst., Nov. 2008, pp. 309-322.
63. S. Kim et al., "Health monitoring of civil infrastructures using wireless sensor networks," in Proc. 6th Int. Conf. Inform. Process. Sensor Netw., Apr. 2007, pp. 254-263.
64. M. Ceriotti et al., "Monitoring heritage buildings with wireless sensor networks: The Torre Aquila deployment," in Proc. Int. Conf. Inform. Process. Sensor Netw., Apr. 2009, pp. 277-288.
65. G. Tolle et al., "A macroscope in the redwoods," in Proc. 3rd Int. Conf. Embedded Netw. Sensor Syst., Nov. 2005, pp. 51-63.
66. F. Wang and J. Liu, "Networked wireless sensor data collection: Issues, challenges, and approaches," IEEE Commun. Surv. Tuts., Vol. 13, no. 4, pp. 673-687, Dec. 2011.
67. J. Shi, J. Wan, H. Yan, and H. Suo, "A survey of cyber-physical systems," in Proc. Int. Conf. Wireless Commun. Signal Process. (WCSP), Nov. 2011, pp. 1-6.
68. Wikipedia. (2013). Scientific Instrument [Online]. Available: http://en.wikipedia.org/wiki/Scientific-instrument
69. M. H. A. Wahab, M. N. H. Mohd, H. F. Hanafi, and M. F. M. Mohsin, "Data pre-processing on web server logs for generalized association rules mining algorithm," World Acad. Sci., Eng. Technol., Vol. 48, p. 970, 2008.
70. A. Nanopoulos, Y. Manolopoulos, M. Zakrzewicz, and T. Morzy, "Indexing web access-logs for pattern queries," in Proc. 4th Int. Workshop Web Inf. Data Manag., 2002, pp. 63-68.
71. K. P. Joshi, A. Joshi, and Y. Yesha, "On using a warehouse to analyze web logs," Distrib. Parallel Databases, Vol. 13, no. 2, pp. 161-180, 2003.
72. J. Cho and H. Garcia-Molina, "Parallel crawlers," in Proc. 11th Int. Conf. World Wide Web, 2002, pp. 124-135.
73. C. Castillo, "Effective web crawling," ACM SIGIR Forum, Vol. 39, no. 1, pp. 55-56, 2005.
74. S. Choudhary et al., "Crawling rich internet applications: The state of the art." in Proc. Conf. Center Adv. Studies Collaborative Res. (CASCON), 2012, pp. 146-160.
75. (2013, Oct. 31). Robots [Online]. Available: http://user-agent-string.info/list-of-ua/bots
76. A. K. Jain, R. Bolle, and S. Pankanti, Biometrics: Personal Identification in Networked Society. Norwell, MA, USA: Kluwer, 1999.
77. N. Ghani, S. Dixit, and T.-S. Wang, "On IP-over-WDM integration," IEEE Commun. Mag., Vol. 38, no. 3, pp. 72-84, Mar. 2000.
78. J. Manchester, J. Anderson, B. Doshi, and S. Dravida, "Ip over SONET," IEEE Commun. Mag., Vol. 36, no. 5, pp. 136-142, May 1998.
79. J. Armstrong, "OFDM for optical communications," J. Lightw. Technol., Vol. 27, no. 3, pp. 189-204, Feb. 1, 2009.
80. W. Shieh, "OFDM for flexible high-speed optical networks," J. Lightw. Technol., Vol. 29, no. 10, pp. 1560-1577, May 15, 2011.
81. M. Jinno, H. Takara, and B. Kozicki, "Dynamic optical mesh networks: Drivers, challenges and solutions for the future," in Proc. 35th Eur. Conf. Opt. Commun. (ECOC), 2009, pp. 1-4.
82. M. Goutelle et al., "A survey of transport protocols other than standard TCP," Data Transp. Res. Group, Namur, Belgium, Tech. Rep. GFD-I.055, 2005.
83. U. Hoelzle and L. A. Barroso, The Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines, 1st ed. San Mateo, CA, USA: Morgan Kaufmann, 2009.
84. Cisco Data Center Interconnect Design and Deployment Guide, Cisco, San Jose, CA, USA, 2009.
85. A. Greenberg et al., "VL2: A scalable and flexible data center network," in Proc. ACM SIGCOMM Conf. Data Commun., 2009, pp. 51-62.
86. C. Guo et al., "BCube: A high performance, server-centric network architecture for modular data centers," SIGCOMM Comput. Commun. Rev., Vol. 39, no. 4, pp. 63-74, 2009.
87. N. Farrington et al., "Helios: A hybrid electrical/optical switch architecture for modular data centers," in Proc. ACM SIGCOMM Conf., 2010, pp. 339-350.
88. H. Abu-Libdeh, P. Costa, A. Rowstron, G. O'Shea, and A. Donnelly, "Symbiotic routing in future data centers," ACM SIGCOMM Comput. Commun. Rev., Vol. 40, no. 4, pp. 51-62, Oct. 2010.
89. C. Lam, H. Liu, B. Koley, X. Zhao, V. Kamalov, and V. Gill, "Fiber optic communication technologies: What's needed for datacenter network operations," IEEE Commun. Mag., Vol. 48, no. 7, pp. 32-39, Jul. 2010.
90. C. Kachris and I. Tomkos, "The rise of optical interconnects in data centre networks," in Proc. 14th Int. Conf. Transparent Opt. Netw. (ICTON), Jul. 2012, pp. 1-4.
91. G. Wang et al., "c-through: Part-time optics in data centers," SIGCOMM Comput. Commun. Rev., Vol. 41, no. 4, pp. 327-338, 2010.
92. X. Ye, Y. Yin, S. B. Yoo, P. Mejia, R. Proietti, and V. Akella, "DOS - A scalable optical switch for datacenters," in Proc. 6th ACM/IEEE Symp. Archit. Netw. Commun. Syst., Oct. 2010, pp. 1-12.
93. A. Singla, A. Singh, K. Ramachandran, L. Xu, and Y. Zhang, "Proteus: A topology malleable data center network," in Proc. 9th ACM SIGCOMM Workshop Hot Topics Netw., 2010, pp. 801-806.
94. O. Liboiron-Ladouceur, I. Cerutti, P. G. Raponi, N. Andriolli, and P. Castoldi, "Energy-efficient design of a scalable optical multiplane interconnection architecture," IEEE J. Sel. Topics Quantum Electron., Vol. 17, no. 2, pp. 377-383, Mar./Apr. 2011.
95. A. K. Kodi and A. Louri, "Energy-efficient and bandwidth-reconfigurable photonic networks for high-performance computing (HPC) systems," IEEE J. Sel. Topics Quantum Electron., Vol. 17, no. 2, pp. 384-395, Mar./Apr. 2011.
96. M. Alizadeh et al., "Data center TCP (DCTCP)," ACM SIGCOMM Comput. Commun. Rev., Vol. 40, no. 4, pp. 63-74, 2010.
97. 2TCP)," ACM SIGCOMM Comput. Commun. Rev., Vol. 42, no. 4, pp. 115-126, 2012.
98. E. Kohler, M. Handley, and S. Floyd, "Designing DCCP: Congestion control without reliability," ACM SIGCOMM Comput. Commun. Rev., Vol. 36, no. 4, pp. 27-38, 2006.
99. H. Müller and J.-C. Freytag. (2005). Problems, methods, and challenges in comprehensive data cleansing. Professoren des Inst. Für Informatik [Online]. Available: http://www.dbis.informatik.hu-berlin.de/fileadmin/research/papers/techreports/2003-hubib164-mueller.pdf
100. N. F. Noy, "Semantic integration: A survey of ontology-based approaches," ACM Sigmod Rec., Vol. 33, no. 4, pp. 65-70, 2004.
101. J. Han, M. Kamber, and J. Pei, Data Mining: Concepts and Techniques. San Mateo, CA, USA: Morgan Kaufmann, 2006.
102. M. Lenzerini, "Data integration: A theoretical perspective," in Proc. 21st ACM SIGMOD-SIGACT-SIGART Symp. Principles Database Syst., 2002, pp. 233-246.
103. A. Silberschatz, H. F. Korth, and S. Sudarshan, Database System Concepts, Vol. 4. New York, NY, USA: McGraw-Hill, 1997.
104. M. J. Cafarella, A. Halevy, and N. Khoussainova, "Data integration for the relational web," Proc. VLDB Endowment, Vol. 2, no. 1, pp. 1090-1101, 2009.
105. J. I. Maletic and A. Marcus, "Data cleansing: Beyond integrity analysis," in Proc. Conf. Inform. Qual., 2000, pp. 200-209.
106. R. Kohavi, L. Mason, R. Parekh, and Z. Zheng, "Lessons and challenges from mining retail e-commerce data," Mach. Learn., Vol. 57, nos. 1-2, pp. 83-113, 2004.
107. H. Chen, W.-S. Ku, H. Wang, and M.-T. Sun, "Leveraging spatiotemporal redundancy for RFID data cleansing," in Proc. ACM SIGMOD Int. Conf. Manag. Data, 2010, pp. 51-62.
108. Z. Zhao and W. Ng, "A model-based approach for RFID data stream cleansing," in Proc. 21st ACM Int. Conf. Inform. Knowl. Manag., 2012, pp. 862-871.
109. N. Khoussainova, M. Balazinska, and D. Suciu, "Probabilistic event extraction from RFID data," in Proc. IEEE 24th Int. Conf. Data Eng. (ICDE), Apr. 2008, pp. 1480-1482.
110. K. G. Herbert and J. T. Wang, "Biological data cleaning: A case study," Int. J. Inform. Qual., Vol. 1, no. 1, pp. 60-82, 2007.
111. Y. Zhang, J. Callan, and T. Minka, "Novelty and redundancy detection in adaptive filtering," in Proc. 25th Annu. Int. ACM SIGIR Conf. Res. Develop. Inform. Retr., 2002, pp. 81-88.
112. D. Salomon, Data Compression. New York, NY, USA: Springer-Verlag, 2004.
113. F. Dufaux and T. Ebrahimi, "Video surveillance using JPEG 2000," in Proc. SPIE, Vol. 5588. 2004, pp. 268-275.
114. P. D. Symes, Digital Video Compression. New York, NY, USA: McGraw-Hill, 2004.
115. T.-H. Tsai and C.-Y. Lin, "Exploring contextual redundancy in improving object-based video coding for video sensor networks surveillance," IEEE Trans. Multimedia, Vol. 14, no. 3, pp. 669-682, Jun. 2012.
116. S. Sarawagi and A. Bhamidipaty, "Interactive deduplication using active learning," in Proc. 8th ACM SIGKDD Int. Conf. Knowl. Discovery Data Mining, 2002, pp. 269-278.
117. Z. Huang, H. Shen, J. Liu, and X. Zhou, "Effective data co-reduction for multimedia similarity search," in Proc. ACM SIGMOD Int. Conf. Manag. Data, 2011, pp. 1021-1032.
118. U. Kamath, J. Compton, R. I. Dogan, K. D. Jong, and A. Shehu, "An evolutionary algorithm approach for feature generation from sequence data and its application to DNA splice site prediction," IEEE/ACM Trans. Comput. Biol. Bioinf., Vol. 9, no. 5, pp. 1387-1398, Sep./Oct. 2012.
119. K. Leung et al., "Data mining on DNA sequences of hepatitis B virus," IEEE/ACM Trans. Comput. Biol. Bioinf., Vol. 8, no. 2, pp. 428-440, Mar./Apr. 2011.
120. J. Bleiholder and F. Naumann, "Data fusion," ACM Comput. Surv., Vol. 41, no. 1, pp. 1-41, 2009.
121. M. Günter, "Introducing MapLan to map banking survey data into a time series database," in Proc. 15th Int. Conf. Extending Database Technol., 2012, pp. 528-533.
122. K. Goda and M. Kitsuregawa, "The history of storage systems," Proc. IEEE, Vol. 100, no. 13, pp. 1433-1440, May 2012.
123. J. D. Strunk, "Hybrid aggregates: Combining SSDS and HDDSina single storage pool," ACM SIGOPS Oper. Syst. Rev., Vol. 46, no. 3, pp. 50-56, 2012.
124. G. Soundararajan, V. Prabhakaran, M. Balakrishnan, and T. Wobber, "Extending SSD lifetimes with disk-based write caches," in Proc. 8th USENIX Conf. File Storage Technol., 2010, p. 8.
125. J. Guerra, H. Pucha, J. S. Glider, W. Belluomini, and R. Rangaswami, "Cost effective storage using extent based dynamic tiering," in Proc. 9th USENIX Conf. File Stroage Technol. (FAST), 2011, pp. 273-286.
126. U. Troppens, R. Erkens, W. Mueller-Friedt, R. Wolafka, and N. Haustein, Storage Networks Explained: Basics and Application of Fibre Channel SAN, NAS, ISCSI, Infiniband and FCoE. New York, NY, USA: Wiley, 2011.
127. P. Mell and T. Grance, "The NIST definition of cloud computing," National Inst. Standards Technol., Vol. 53, no. 6, p. 50, 2009.
128. T. Clark, Storage Virtualization: Technologies for Simplifying Data Storage and Management. Reading, MA, USA: Addison-Wesley, 2005.
129. M.K. McKusick and S. Quinlan, "GFS: Evolutiononfast-forward," ACM Queue, Vol. 7, no. 7, pp. 10-20, 2009.
130. (2013). Hadoop Distributed File System [Online]. Available: http://hadoop.apache.org/docs/r1.0.4/hdfsdesign.html
131. (2013). Kosmosfs [Online]. Available: https://code.google.com/p/kosmosfs/
132. R. Chaiken et al., "Scope: Easy and efficient parallel processing of massive data sets," Proc. VLDB Endowment, Vol. 1, no. 2, pp. 1265-1276, 2008.
133. D. Beaver, S. Kumar, H. C. Li, J. Sobel, and P. Vajgel, "Finding a needle in Haystack: Facebook's photo storage," in Proc. 9th USENIX Conf. Oper. Syst. Des. Implement. (OSDI), 2010, pp. 1-8.
134. (2013). Taobao File System [Online]. Available: http://code.taobao.org/p/tfs/src/
135. (2013). Fast Distributed File System [Online]. Available: https://code.google.com/p/fastdfs/
136. G. DeCandia et al., "Dynamo: Amazon's highly available key-value store," SIGOPS Oper. Syst. Rev., Vol. 41, no. 6, pp. 205-220, 2007.
137. D. Karger, E. Lehman, T. Leighton, R. Panigrahy, M. Levine, and D. Lewin, "Consistent hashing and random trees: Distributed caching protocols for relieving hot spots on the World Wide Web," in Proc. 29th Annu. ACM Symp. Theory Comput., 1997, pp. 654-663.
138. (2013). Voldemort [Online]. Available: http://www.projectvoldemort.com/voldemort/
139. (2013, Oct. 31). Redis [Online]. Available: http://redis.io/
140. (2013). Tokyo Canbinet [Online]. Available: http://fallabs.com/tokyocabinet/
141. (2013). Tokyo Tyrant [Online]. Available: http://fallabs.com/tokyotyrant/
142. (2013, Oct. 31). Memcached [Online]. Available: http://memcached.org/
143. (2013, Oct. 31). MemcacheDB [Online]. Available: http://memcachedb.org/
144. (2013, Oct. 31). Riak [Online]. Available: http://basho.com/riak/
145. (2013). Scalaris [Online]. Available: http://code.google.com/p/scalaris/
146. F. Chang et al., "Bigtable: A distributed storage system for structured data," ACM Trans. Comput. Syst., Vol. 26, no. 2, pp. 4:1-4:26, Jun. 2008.
147. M. Burrows, "The chubby lock service for loosely-coupled distributed systems," in Proc. 7th Symp. Oper. Syst. Des. Implement., 2006, pp. 335-350.
148. A. Lakshman and P. Malik, "Cassandra: Structured storage system on a p2p network," in Proc. 28th ACM Symp. Principles Distrib. Comput., 2009, p. 5.
149. (2013). HBase [Online]. Available: http://hbase.apache.org/
150. (2013). Hypertable [Online]. Available: http://hypertable.org/
151. D. Crochford. (2006). RFC 4627-The Application/JSON Media Type for Javascript Object Notation (JSON) [Online]. Available: http://tools.ietf.org/html/rfc4627
152. (2013). MongoDB [Online]. Available: http://www.mongodb.org/
153. (2013). Neo4j [Online]. Available: http://www.neo4j.org/
154. (2013). Dex [Online]. Available: http://www.sparsitytechnologies.com/dex.php
155. B. F. Cooper et al, "PNUTS: Yahoo!'s hosted data serving platform," in Proc. VLDB Endowment, Vol. 1, no. 2, pp. 1277-1288, 2008.
156. J. Baker et al., "Megastore: Providing scalable, highly available storage for interactive services," in Proc. Conf. Innov. Database Res. (CIDR), 2011, pp. 223-234.
157. J. C. Corbett et al, "Spanner: Google's globally-distributed database," in Proc. 10th Conf. Oper. Syst. Des. Implement. (OSDI), 2012.
158. J. Shute et al., "F1: The fault-tolerant distributed RDBMS supporting Google's ad business," in Proc. Int. Conf. Manag. Data, 2012, pp. 777-778.
159. B. F. Cooper, A. Silberstein, E. Tam, R. Ramakrishnan, and R. Sears, "Benchmarking cloud serving systems with YCSB," in Proc. 1st ACM Symp. Cloud Comput., 2010, pp. 143-154.
160. T. Kraska, M. Hentschel, G. Alonso, and D. Kossmann, "Consistency rationing in the cloud: Pay only when it matters," Proc. VLDB Endowment, Vol. 2, no. 1, pp. 253-264, 2009.
161. K. Keeton, C. B. Morrey, III, C. A. Soules, and A. Veitch, "Lazybase: Freshness vs. performance in information management," SIGOPS Oper. Syst. Rev., Vol. 44, no. 1, pp. 15-19, Jan. 2010.
162. D. Florescu and D. Kossmann, "Rethinking cost and performance of database systems," ACM SIGMOD Rec., Vol. 38, no. 1, pp. 43-48, Mar. 2009.
163. E. A. Brewer, "Towards robust distributed systems (abstract)," in Proc. 19th Annu. ACM Symp. Principles Distrib. Comput. (PODC), 2000, p. 7.
164. S. Gilbert and N. Lynch, "Brewer's conjecture and the feasibility of consistent, available, partition-tolerant web services," ACM SIGACT News, Vol. 33, no. 2, pp. 51-59, Jun. 2002.
165. A. S. Tanenbaum and M. V. Steen, Distributed Systems: Principles and Paradigms, 2nd ed. Upper Saddle River, NJ, USA: Prentice-Hall, 2006.
166. L. Dagum and R. Menon, "OpenMP: An industry standard API for shared-memory programming," IEEE Comput. Sci. & Eng., Vol. 5, no. 1, pp. 46-55, Jan./Mar. 1998.
167. D. W. Walker and J. J. Dongarra, "MPI: A standard message passing interface," Supercomputer, Vol. 12, pp. 56-68, 1996.
168. R. Pike, S. Dorward, R. Griesemer, and S. Quinlan, "Interpreting the data: Parallel analysis with sawzall," Sci. Program., Vol. 13, no. 4, pp. 277-298, 2005.
169. A. F. Gates et al, "Building a high-level dataflow system on top of Map-Reduce: The Pig experience," Proc. VLDB Endowment, Vol. 2, no. 2, pp. 1414-1425, Aug. 2009.
170. A. Thusoo et al., "Hive: A warehousing solution over a Map-Reduce framework," Proc. VLDB Endowment, Vol. 2, no. 2, pp. 1626-1629, 2009.
171. Y. Yu et al., "DryadLINQ: A system for general-purpose distributed dataparallel computing using a high-level language," in Proc. 8th USENIX Conf. Oper. Syst. Des. Implement., 2008, pp. 1-14.
172. Y. Low, D. Bickson, J. Gonzalez, C. Guestrin, A. Kyrola, and J. M. Hellerstein, "Distributed graphlab: A framework for machine learning and data mining in the cloud," Proc. VLDB Endowment, Vol. 5, no. 8, pp. 716-727, 2012.
173. C. Moretti, J. Bulosan, D. Thain, and P. J. Flynn, "All-pairs: An abstraction for data-intensive cloud computing," in Proc. IEEE Int. Symp. Parallel Distrib. Process. (IPDPS), Apr. 2008, pp. 1-11.
174. Y. Bu, B. Howe, M. Balazinska, and M. D. Ernst, "HaLoop: Efficient iterative data processing on large clusters," Proc. VLDB Endowment, Vol. 3, nos. 1-2, pp. 285-296, 2010.
175. J. Ekanayake et al., "Twister: A runtime for iterative mapreduce," in Proc. 19th ACM Int. Symp. High Perform. Distrib. Comput., 2010, pp. 810-818.
176. M. Zaharia et al., "Resilient distributed datasets: A fault-tolerant abstraction for in-memory cluster computing," in Proc. 9th USENIX Conf. Netw. Syst. Des. Implement., 2012, p. 2.
177. P. Bhatotia, A. Wieder, R. Rodrigues, U. A. Acar, and R. Pasquin, "Incoop: Mapreduce for incremental computations," in Proc. 2nd ACM Symp. Cloud Comput., 2011, pp. 1-14.
178. D. Peng and F. Dabek, "Large-scale incremental processing using distributed transactions and notifications," in Proc. 9th USENIX Conf. Oper. Syst. Des. Implement., 2010, pp. 1-15.
179. C. Yan, X. Yang, Z. Yu, M. Li, and X. Li, "IncMR: Incremental data processing based on mapreduce," in Proc. IEEE 5th Int. Conf. Cloud Comput. (CLOUD), Jun. 2012, pp. 534-541.
180. C. Olston et al., "Nova: Continuous Pig/hadoop workflows," in Proc. Int. Conf. Manag. Data, 2011, pp. 1081-1090.
181. D. G. Murray, M. Schwarzkopf, C. Smowton, S. Smith, A. Madhavapeddy, and S. Hand, "Ciel: A universal execution engine for distributed data-flow computing," in Proc. 8th USENIX Conf. Netw. Syst. Des. Implement., 2011, p. 9.
182. A. H. Eschenfelder, Data Mining and Knowledge Discovery Handbook, Vol. 14. Berlin, Germany: Springer-Verlag, 1980.
183. C. A. Bhatt and M. S. Kankanhalli, "Multimedia data mining: State of the art and challenges," Multimedia Tools Appl., Vol. 51, no. 1, pp. 35-76, 2011.
184. G. Blackett. (2013). Analytics Network-O.R. Analytics [Online]. Available: http://www.theorsociety.com/Pages/SpecialInterest/AnalyticsNetwork-anal%ytics.aspx
185. J. Richardson, K. Schlegel, B. Hostmann, and N. McMurchy. (2008). Magic quadrant for business intelligence platforms [Online]. Available: http://www2.microstrategy.com/download/files/whitepapers/open/Gartner-Magic-Quadrant-for-BI-Platforms-2012.pdf
186. T. Economist. (2011). Beyond the PC, Tech. Rep. [Online]. Available: http://www.economist.com/node/21531109
187. N. S. Foundation. (2013). Core Techniques and Technologies for Advancing Big Data Science and Engineering [Online]. Available: http://www.nsf.gov/pubs/2012/nsf12499/nsf12499.htm
188. (2013). iPlant [Online]. Available: http://www.iplantcollaborative.org/about
189. V. Friedman. (2008). Data visualization and infographics [Online]. Available: http://www.smashingmagazine.com/2008/01/14/monday-inspiration-data-visualization-and-infographics/
190. V. Friedman. Data visualization: Modern approaches [Online]. Available: http://www.smashingmagazine.com/2007/08/02/data-visualization-modern-approaches/
191. F. H. Post, G. M. Nielson, and G.-P. Bonneau, Data Visualization: The State of the Art. Berlin, Germany: Springer-Verlag, 2003.
192. T. W. Anderson, T. W. Anderson, T. W. Anderson, and T. W. Anderson, An Introduction to Multivariate Statistical Analysis, 3rd ed. New York, NY, USA: Wiley, 2003.
193. X. Wu et al., "Top 10 algorithms in data mining," Knowl. Inform. Syst., Vol. 14, no. 1, pp. 1-37, 2007.
194. G. E. Hinton, "Learning multiple layers of representation," Trends Cognit. Sci., Vol. 11, no. 10, pp. 428-434, 2007.
195. G. K. Baah, A. Gray, and M. J. Harrold, "On-line anomaly detection of deployed software: A statistical machine learning approach," in Proc. 3rd Int. Workshop Softw. Qual. Assurance, 2006, pp. 70-77.
196. M. Moeng and R. Melhem, "Applying statistical machine learning to multicore voltage & frequency scaling," in Proc. 7th ACM Int. Conf. Comput. Frontiers, 2010, pp. 277-286.
197. M. M. Gaber, A. Zaslavsky, and S. Krishnaswamy, "Mining data streams: A review," ACM SIGMOD Rec., Vol. 34, no. 2, pp. 18-26, Jun. 2005.
198. V. S. Verykios, E. Bertino, I. N. Fovino, L. P. Provenza, Y. Saygin, and Y. Theodoridis, "State-of-the-art in privacy preserving data mining," ACM SIGMOD Rec., Vol. 33, no. 1, pp. 50-57, Mar. 2004.
199. W. van der Aalst, "Process mining: Overview and opportunities," ACM Trans. Manag. Inform. Syst., Vol. 3, no. 2, pp. 7:1-7:17, Jul. 2012.
200. G. Salton, "Automatic text processing," Science, Vol. 168, no. 3929, pp. 335-343, 1970.
201. C. D. Manning and H. Schütze, Foundations of Statistical Natural Language Processing. Cambridge, MA, USA: MIT Press, 1999.
202. A. Ritter, S. Clark, and O. Etzioni, "Named entity recognition in tweets: An experimental study," in Proc. Conf. Empirical Methods Nat. Lang. Process., 2011, pp. 1524-1534.
203. Y. Li, X. Hu, H. Lin, and Z. Yang, "A framework for semisupervised feature generation and its applications in biomedical literature mining," IEEE/ACM Trans. Comput. Biol. Bioinform., Vol. 8, no. 2, pp. 294-307, 2011.
204. D. M. Blei, "Probabilistic topic models," Commun. ACM, Vol. 55, no. 4, pp. 77-84, 2012.
205. H. Balinsky, A. Balinsky, and S. J. Simske, "Automatic text summarization and small-world networks," in Proc. 11th ACM Symp. Document Eng., 2011, pp. 175-184.
206. M. Mishra, J. Huan, S. Bleik, and M. Song, "Biomedical text categorization with concept graph representations using a controlled vocabulary," in Proc. 11th Int. Workshop Data Mining Bioinform., 2012, pp. 26-32.
207. J. Hu et al., "Enhancing text clustering by leveraging wikipedia semantics," in Proc. 31st Annu. Int. ACM SIGIR Conf. Res. Develop. Inform. Retr., 2008, pp. 179-186.
208. M. T. Maybury, New Directions in Question Answering. Menlo Park, CA, USA: AAAI press, 2004.
209. B. Pang and L. Lee, "Opinion mining and sentiment analysis," Found. Trends Inform. Retr., Vol. 2, nos. 1-2, pp. 1-135, 2008.
210. S. K. Pal, V. Talwar, and P. Mitra, "Web mining in soft computing framework: Relevance, state of the art and future directions," IEEE Trans. Neural Netw., Vol. 13, no. 5, pp. 1163-1177, 2002.
211. S. Chakrabarti, "Data mining for hypertext: A tutorial survey," ACM SIGKDD Explorations Newslett., Vol. 1, no. 2, pp. 1-11, 2000.
212. S. Brin and L. Page, "The anatomy of a large-scale hypertextual web search engine," in Proc. 7th Int. Conf. World Wide Web, 1998, pp. 107-117.
213. D. Konopnicki and O. Shmueli, "W3QS: A query system for the worldwide web," in Proc. 21th Int. Conf. Very Large Data Bases, 1995, pp. 54-65.
214. S. Chakrabarti, M. van den Berg, and B. Dom, "Focused crawling: A new approach to topic-specific web resource discovery," Comput. Netw., Vol. 31, nos. 11-16, pp. 1623-1640, 1999.
215. B. Xu, J. Bu, C. Chen, and D. Cai, "An exploration of improving collaborative recommender systems via user-item subgroups," in Proc. 21st Int. Conf. World Wide Web, 2012, pp. 21-30.
216. D. Ding et al., "Beyond audio and video retrieval: Towards multimedia summarization," in Proc. 2nd ACM Int. Conf. Multimedia Retr., 2012, pp. 2:1-2:8.
217. M. Wang, B. Ni, X.-S. Hua, and T.-S. Chua, "Assistive tagging: A survey of multimedia tagging with human-computer joint exploration," ACM Comput. Surv., Vol. 44, no. 4, pp. 25:1-25:24, 2012.
218. W. Hu, N. Xie, L. Li, X. Zeng, and S. Maybank, "A survey on visual content-based video indexing and retrieval," IEEE Trans. Syst., Man, Cybern. C, Appl. Rev., Vol. 41, no. 6, pp. 797-819, Nov. 2011.
219. X. Li, S. Lin, S. Yan, and D. Xu, "Discriminant locally linear embedding with high-order tensor data," IEEE Trans. Syst., Man, Cybern. B, Cybern., Vol. 38, no. 2, pp. 342-352, Apr. 2008.
220. X. Li and Y. Pang, "Deterministic column-based matrix decomposition," IEEE Trans. Knowl. Data Eng., Vol. 22, no. 1, pp. 145-149, Jan. 2010.
221. X. Li, Y. Pang, and Y. Yuan, "L1-norm-based 2DPCA," IEEE Trans. Syst., Man, Cybern. B Cybern., Vol. 40, no. 4, pp. 1170-1175, Apr. 2010.
222. Y.-J. Park and K.-N. Chang, "Individual and group behavior-based customer profile model for personalized product recommendation," Expert Syst. Appl., Vol. 36, no. 2, pp. 1932-1939, 2009.
223. L. M. de Campos, J. M. Fernández-Luna, J. F. Huete, and M. A. Rueda-Morales, "Combining content-based and collaborative recommendations: A hybrid approach based on bayesian networks," Int. J. Approx. Reason., Vol. 51, no. 7, pp. 785-799, 2010.
224. Y.-G. Jiang et al., "Columbia-UCF TRECvid2010 multimedia event detection: Combining multiple modalities, contextual concepts, and temporal matching," in Proc. Nat. Inst. Standards Technol. (NIST) TRECvid Workshop, Vol. 2. 2010, p. 6.
225. Z. Ma, Y. Yang, Y. Cai, N. Sebe, and A. G. Hauptmann, "Knowledge adaptation for ad hoc multimedia event detection with few exemplars," in Proc. 20th Assoc. Comput. Mach. (ACM) Int. Conf. Multimedia, 2012, pp. 469-478.
226. J. E. Hirsch, "An index to quantify an individual's scientific research output," Proc. Nat. Acad. Sci. United States Amer., Vol. 102, no. 46, p. 16569, 2005.
227. D. J. Watts, Six Degrees: The Science of a Connected Age. New York, NY, USA: Norton, 2004.
228. C. C. Aggarwal, An Introduction to Social Network Data Analytics. Berlin, Germany: Springer-Verlag, 2011.
229. S. Scellato, A. Noulas, and C. Mascolo, "Exploiting place features in link prediction on location-based social networks," in Proc. 17th Assoc. Comput. Mach. (ACM) Special Interest Group Knowl. Discovery Data (SIGKDD) Int. Conf. Knowl. Discovery Data Mining, 2011, pp. 1046-1054.
230. A. Ninagawa and K. Eguchi, "Link prediction using probabilistic group models ofnetwork structure," in Proc. Assoc. Comput. Mach. (ACM) Symp. Appl. Comput., 2010, pp. 1115-1116.
231. D. M. Dunlavy, T. G. Kolda, and E. Acar, "Temporal link prediction using matrix and tensor factorizations," ACM Trans. Knowl. Discovery Data, Vol. 5, no. 2, pp. 10:1-10:27, 2011.
232. J. Leskovec, K. J. Lang, and M. Mahoney, "Empirical comparison of algorithms for network community detection," in Proc. 19th Int. Conf. World Wide Web, 2010, pp. 631-640.
233. N. Du, B. Wu, X. Pei, B. Wang, and L. Xu, "Community detection in large-scale social networks," in Proc. 9th WebKDD 1st SNA-KDD Workshop Web Mining Soc. Netw. Anal., 2007, pp. 16-25.
234. S. Garg, T. Gupta, N. Carlsson, and A. Mahanti, "Evolution of an online social aggregation network: An empirical study," in Proc. 9th Assoc. Comput. Mach. (ACM) SIGCOMM Conf. Internet Meas. Conf., 2009, pp. 315-321.
235. M. Allamanis, S. Scellato, and C. Mascolo, "Evolution of a location-based online social network: Analysis and models," in Proc. Assoc. Comput. Mach. (ACM) Conf. Internet Meas. Conf., 2012, pp. 145-158.
236. N. Z. Gong et al, "Evolution of social-attribute networks: Measurements, modeling, and implications using google+," in Proc. Assoc. Comput. Mach. (ACM) Conf. Internet Meas. Conf., 2012, pp. 131-144.
237. E. Zheleva, H. Sharara, and L. Getoor, "Co-evolution of social and affiliation networks," in Proc. 15th Assoc. Comput. Mach. (ACM) SIGKDD Int. Conf. Knowl. Discovery Data Mining, 2009, pp. 1007-1016.
238. J. Tang, J. Sun, C. Wang, and Z. Yang, "Social influence analysis in large-scale networks," in Proc. 15th Assoc. Comput. Mach. (ACM) SIGKDD Int. Conf. Knowl. Discovery Data Mining, 2009, pp. 807-816.
239. Y. Li, W. Chen, Y. Wang, and Z.-L. Zhang, "Influence diffusion dynamics and influence maximization in social networks with friend and foe relationships," in Proc. 6th Assoc. Comput. Mach. (ACM) Int. Conf. Web Search Data Mining, 2013, pp. 657-666.
240. T. Lappas, K. Liu, and E. Terzi, "Finding a team of experts in social networks," in Proc. 15th Assoc. Comput. Mach. (ACM) SIGKDD Int. Conf. Knowl. Discovery Data Mining, 2009, pp. 467-476.
241. T. Zhang, A. Popescul, and B. Dom, "Linear prediction models with graph regularization for web-page categorization," in Proc. 12th Assoc. Comput. Mach. (ACM) SIGKDD Int. Conf. Knowl. Discovery Data Mining, 2006, pp. 821-826.
242. Y. Zhou, H. Cheng, and J. X. Yu, "Graph clustering based on structural/attribute similarities," Proc. VLDB Endowment, Vol. 2, no. 1, pp. 718-729, 2009.
243. W. Dai, Y. Chen, G.-R. Xue, Q. Yang, and Y. Yu, "Translated learning: Transfer learning across different feature spaces," in Proc. Adv. Neural Inform. Process. Syst. (NIPS), 2008, pp. 353-360.
244. M. Rabbath, P. Sandhaus, and S. Boll, "Multimedia retrieval in social networks for photo book creation," in Proc. 1st Assoc. Comput. Mach. (ACM) Int. Conf. Multimedia Retr., 2011, pp. 72:1-72:2.
245. S. Shridhar, M. Lakhanpuria, A. Charak, A. Gupta, and S. Shridhar, "Snair: A framework for personalised recommendations based on social network analysis," in Proc. 5th Int. Workshop Location-Based Soc. Netw., 2012, pp. 55-61.
246. S. Maniu and B. Cautis, "Taagle: Efficient, personalized search in collaborative tagging networks," in Proc. Assoc. Comput. Mach. (ACM) SIGMOD Int. Conf. Manag. Data, 2012, pp. 661-664.
247. H. Hu, J. Huang, H. Zhao, Y. Wen, C. W. Chen, and T.-S. Chua, "Social tv analytics: A novel paradigm to transform tv watching experience," in Proc. 5th Assoc. Comput. Mach. (ACM) Multimedia Syst. Conf., 2014, pp. 172-175.
248. H. Hu, Y. Wen, H. Luan, T.-S. Chua, and X. Li, "Towards multi-screen social tv with geo-aware social sense," IEEE Multimedia, to be published.
249. H. Zhang, Z. Zhang, and H. Dai, "Gossip-based information spreading in mobile networks," IEEE Trans. Wireless Commun., Vol. 12, no. 11, pp. 5918-5928, Nov. 2013.
250. H. Zhang, Z. Zhang, and H. Dai, "Mobile conductance and gossip-based information spreading in mobile networks," in IEEE Int. Symp. Inf. Theory Proc. (ISIT), Jul. 2013, pp. 824-828.
251. H. Zhang, Y. Huang, Z. Zhang, and H. Dai. (2014). Mobile conductance in sparse networks and mobility-connectivity tradeoff. in Proc. IEEE Int. Symp. Inf. Theory (ISIT) [Online]. Available: http://www4.ncsu.edu/?hdai/ISIT2014-HZ.pdf
252. Cisco Syst., Inc., "Cisco visual networking index: Global mobile data traffic forecast update," Cisco Syst., Inc., San Jose, CA, USA, Cisco Tech. Rep. 2012-2017, 2013.
253. J. Han, J.-G. Lee, H. Gonzalez, and X. Li, "Mining massive RFID, trajectory, and traffic data sets," in Proc. 14th ACM SIGKDD Int. Conf. Knowl. Discovery Data Mining (KDD), 2008.
254. E. Wu, Y. Diao, and S. Rizvi, "High-performance complex event processing over streams," in Proc. Assoc. Comput. Mach. (ACM) SIGMOD Int. Conf. Manag. Data, 2006, pp. 407-418.
255. M. K. Garg, D.-J. Kim, D. S. Turaga, and B. Prabhakaran, "Multimodal analysis of body sensor network data streams for real-time healthcare," in Proc. Int. Conf. Multimedia Inform. Retr., 2010, pp. 469-478.
256. Y. Park and J. Ghosh, "A probabilistic imputation framework for predictive analysis using variably aggregated, multi-source healthcare data," in Proc. 2nd Assoc. Comput. Mach. (ACM) SIGHIT Int. Health Inform. Symp., 2012, pp. 445-454.
257. T. Gunarathne, T.-L. Wu, J. Qiu, and G. Fox, "Cloud computing paradigms for pleasingly parallel biomedical applications," in Proc. 19th Assoc. Comput. Mach. (ACM) Int. Symp. High Perform. Distrib. Comput., 2010, pp. 460-469.
258. Y. Bu, B. Howe, M. Balazinska, and M. D. Ernst, "Haloop: Efficient iterative data processing on large clusters," Proc. VLDB Endowment, Vol. 3, nos. 1-2, pp. 285-296, 2010.
259. J. Ekanayake et al., "Twister: A runtime for iterative mapreduce," in Proc. 19th Assoc. Comput. Mach. (ACM) Int. Symp. High Perform. Distrib. Comput., 2010, pp. 810-818.
260. D. Logothetis and K. Yocum, "Ad-hoc data processing in the cloud," Proc. VLDB Endowment, Vol. 1, no. 2, pp. 1472-1475, 2008.
261. T. Condie, N. Conway, P. Alvaro, J. M. Hellerstein, K. Elmeleegy, and R. Sears, "Mapreduce online," in Proc. 7th USENIX Conf. Netw. Syst. Des. Implement., 2010, p. 21.
262. B. Li, E. Mazur, Y. Diao, A. McGregor, and P. Shenoy, "A platform for scalable one-pass analytics using mapreduce," in Proc. Assoc. Comput. Mach. (ACM) SIGMOD Int. Conf. Manag. Data, 2011, pp. 985-996.
263. D. Jiang, B. C. Ooi, L. Shi, and S. Wu, "The performance of mapreduce: An in-depth study," Proc. VLDB Endowment, Vol. 3, nos. 1-2, pp. 472-483, 2010.
264. J. Dittrich, J.-A. Quiané-Ruiz, A. Jindal, Y. Kargin, V. Setty, and J. Schad, "Hadoop++: Making a yellow elephant run like a cheetah (without it even noticing)," Proc. VLDB Endowment, Vol. 3, nos. 1-2, pp. 515-529, 2010.
265. A. Abouzied, K. Bajda-Pawlikowski, J. Huang, D. J. Abadi, and A. Silberschatz, "Hadoopdb in action: Building real world applications," in Proc. Assoc. Comput. Mach. (ACM) SIGMOD Int. Conf. Manag. Data, 2010, pp. 1111-1114.
266. M. Zaharia, D. Borthakur, J. Sen Sarma, K. Elmeleegy, S. Shenker, and I. Stoica, "Delay scheduling: A simple technique for achieving locality and fairness in cluster scheduling," in Proc. 5th Eur. Conf. Comput. Syst., 2010, pp. 265-278.
267. T. Sandholm and K. Lai, "Dynamic proportional share scheduling in Hadoop," in Job Scheduling Strategies for Parallel Processing. Berlin, Germany: Springer-Verlag, 2010, pp. 110-131.
268. K. Kc and K. Anyanwu, "Scheduling hadoop jobs to meet deadlines," in Proc. IEEE 2nd Int. Conf. Cloud Comput. Technol. Sci. (CloudCom), Nov./Dec. 2010, pp. 388-392.
269. M. Yong, N. Garegrat, and S. Mohan, "Towards a resource aware scheduler in Hadoop," in Proc. Int. Conf. Web Services (ICWS), 2009, pp. 102-109.
270. S. Blanas, J. M. Patel, V. Ercegovac, J. Rao, E. J. Shekita, and Y. Tian, "A comparison of join algorithms for log processing in mapreduce," in Proc. Assoc. Comput. Mach. (ACM) (SIGMOD) Int. Conf. Manag. Data, 2010, pp. 975-986.
271. J. Lin and C. Dyer, "Data-intensive text processing with mapreduce," Synthesis Lect. Human Lang. Technol., Vol. 3, no. 1, pp. 1-177, 2010.
272. S. Babu, "Towards automatic optimization of mapreduce programs," in Proc. 1st Assoc. Comput. Mach. (ACM) Symp. Cloud Comput., 2010, pp. 137-142.
273. E. Jahani, M. J. Cafarella, and C. Ré, "Automatic optimization for mapreduce programs," Proc. VLDB Endowment, Vol. 4, no. 6, pp. 385-396, 2011.
274. J. Leverich and C. Kozyrakis, "On the energy (in) efficiency of hadoop clusters," Assoc. Comput. Mach. (ACM) SIGOPS Operat. Syst. Rev., Vol. 44, no. 1, pp. 61-65, 2010.
275. W. Lang and J. M. Patel, "Energy management for mapreduce clusters," Proc. VLDB Endowment, Vol. 3, nos. 1-2, pp. 129-139, 2010.
276. K.-H. Lee, Y.-J. Lee, H. Choi, Y. D. Chung, and B. Moon, "Parallel data processing with mapreduce: A survey," Assoc. Comput. Mach. (ACM) SIGMOD Rec., Vol. 40, no. 4, pp. 11-20, 2012.
277. B. T. Rao and L. Reddy. (2012). Survey on improved scheduling in hadoop mapreduce in cloud environments. arXiv preprint arXiv:1207.0780 [Online]. Available: http://arxiv.org/pdf/1207.0780.pdf
278. (2013). Summingbird [Online]. Available: http://github.com/twitter/summingbird
279. Y. Chen, "We don't know enough to make a big data benchmark suite - An academia-industry view," in Proc. Workshop Big Data Benchmarking (WBDB), 2012.
280. (2013). TPC Benchmarks [Online]. Available: http://www.tpc.org/information/benchmarks.asp
281. R. O. Nambiar and M. Poess, "The making of TPC-DS," in Proc. 32nd Int. Conf. Very Large Data Bases (VLDB) Endowment, 2006, pp. 1049-1058.
282. S. Patil et al., "Ycsb++: Benchmarking and performance debugging advanced features in scalable table stores," in Proc. 2nd Assoc. Comput. Mach. (ACM) Symp. Cloud Comput., 2011, p. 9.
283. T. Rabl, S. Gómez-Villamor, M. Sadoghi, V. Muntés-Mulero, H.-A. Jacobsen, and S. Mankovskii, "Solving big data challenges for enterprise application performance management," Proc. VLDB Endowment, Vol. 5, no. 12, pp. 1724-1735, 2012.
284. (2013). Grid Mix [Online]. Available: http://hadoop.apache.org/docs/stable/gridmix.html
285. (2013). Pig Mix [Online]. Available: http://cwiki.apache.org/PIG/pigmix.html
286. A. Pavlo et al., "A comparison of approaches to large-scale data analysis," in Proc. 35th SIGMOD Int. Conf. Manag. Data, 2009, pp. 165-178.
287. (2013). Gray Sort [Online]. Available: http://sortbenchmark.org/
288. Y. Chen, A. Ganapathi, R. Griffith, and R. Katz, "The case for evaluating mapreduce performance using workload suites," in Proc. IEEE 19th Int. Symp. Model., Anal., Simul. Comput. Telecommun. Syst. (MASCOTS), Jul. 2011, pp. 390-399.
289. Y. Chen, S. Alspaugh, and R. Katz, "Interactive analytical processing in big data systems: A cross-industry study of mapreduce workloads," Proc. VLDB Endowment, Vol. 5, no. 12, pp. 1802-1813, 2012.
290. A. Ghazal et al., "Bigbench: Towards an industry standard benchmark for big data analytics," Proc. Assoc. Comput. Mach. (ACM) SIGMOD Int. Conf. Manag. Data, 2013, pp. 1197-1208.