Big data management: Concepts, techniques and challenges

Jisuanji Yanjiu yu Fazhan/Computer Research and Development

Volumn 50, Issue 1, 2013, Pages 146-169

  Meng, Xiaofeng ^a   Ci, Xiang ^a  

^a RENMIN UNIVERSITY OF CHINA   (China)

Author keywords

Big data; Cloud computing; Data analysis

Indexed keywords

BIG DATUM; DATA TYPE; DATABASE RESEARCH; HUMAN SOCIETY; INTERNET OF THINGS (IOT); KEY TECHNIQUES; NEW SERVICES; SOCIAL NETWORKS; STATE OF THE ART;

CLOUD COMPUTING; DATA REDUCTION; SOCIAL NETWORKING (ONLINE);

INFORMATION MANAGEMENT;

EID: 84874754580     PISSN: 10001239     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Review

References (167)

1. Nature. Big Data [EB/OL]. [2012-10-02]. http://www.nature.com/news/specials/bigdata/index.html
2. Bryant R E, Katz R H, Lazowska E D. Big-Data computing: Creating revolutionary breakthroughs in commerce, science, and society [R]. [2012-10-02]. http://www.cra.org/ccc/docs/init/Big_Data.pdf
3. Science. Special online collection: Dealing with data [EB/OL]. [2012-10-02]. http://www.sciencemag.org/site/special/data/, 2011
4. Agrawal D, Bernstein P, Bertino E, et al. Challenges and opportunities with big data-A community white paper developed by leading researchers across the United States [R/OL]. [2012-10-02]. http://cra.org/ccc/docs/init/bigdata whitepaper.pdf
5. Manyika J, Chui M, Brown B, et al. Big data: The next frontier for innovation, competition, and productivity [R/OL]. [2012-10-02]. http://www.mckinsey.com/Insights/MGI/Research/Technology_and_ Innovation/Big_data_The_next_frontier_for_innovation
6. World Economic Forum. Big data, big impact: New possibilities for international development [R/OL]. [2012-10-02]. http://www3.weforum.org/docs/WEF_TC_MFS_BigDataBigImpact_ Briefing_2012.pdf
7. Big Data Across the Federal Government [EB/OL]. [2012-10-02]. http://www.whitehouse.gov/sites/default/files/microsites/ostp/ big_data_fact_sheet_final_1.pdf
8. UN Global Pulse. Big Data for Development: Challenges & Opportunities [R/OL]. [2012-10-02]. http://www.unglobalpulse.org/projects/BigDataforDevelopment
9. Times N Y. The age of big data [EB/OL]. [2012-10-02]. http://www.nytimes.com/2012/02/12/sunday-review/ big-datas-impact-in-the-world.html?pagewanted=all
10. Grobelnik M. Big-data computing: Creating revolutionary breakthroughs in commerce, science, and society [R/OL]. [2012-10-02]. http://videolectures.net/eswc2012_grobelnik_big_data/
11. Barwick H. The "four Vs" of Big Data. Implementing Information Infrastructure Symposium [EB/OL]. [2012-10-02]. http://www.computerworld.com.au/article/396198/iiis_four_vs_big_data/
12. IBM. What is big data? [EB/OL]. [2012-10-02]. http://www-01.ibm.com/software/data/bigdata/
13. Big data [EB/OL]. [2012-10-02]. http://en.wikipedia.org/wiki/Big_data
14. Hey T, Tansley S, Tolle K. The Fourth Paradigm: Data-intensive Scientific Discovery [M/OL]. Microsoft Research, Redmond, Washington (2009) http://research.microsoft.com/en-us/collaboration/fourthparadigm/
15. Lazer D, et al. Computational social science [J]. Science. 2009, 323: 721-723
16. Watts D J. A twenty-first century science [J]. Nature, 2007, 445(7127): 489
17. The Economist. Data, data, everywhere-A special report on managing information [EB/OL]. [2012-10-02]. http://www.economist.com/node/15557443
18. Kumar R. Two computational paradigm for big data [EB/OL]. [2012-10-02]. KDD summer school, 2012. http://kdd2012.sigkdd.org/sites/images/summerschool/Ravi-Kumar.pdf
19. InformationWeek Report. The big data management challenge [R/OL]. [2012-10-02]. http://reports.information week.com/abstract/81/8766/business-intelligence-and-information- management/research-the-big-data-management-challenge.html
20. Storm [EB/OL]. [2012-10-02]. https://github.com/nathanmarz/storm
21. Neumeyer L, Robbins B, Nair A, et al. S4: Distributed Stream Computing Platform [C]//Proc of ICDM Workshops 2010. Piscataway, NJ: IEEE, 2010: 170-177
22. Goodhope K, Koshy J, Kreps J, et al. Building LinkedIn's Real-time Activity Data Pipeline [J]. Data Engineering, 2012, 35(2): 33-45
23. Dean J, Ghemawat S. MapReduce: Simplified data processing on large clusters [C]//Proc of OSDI 2004. Berkeley, CA: USENIX Association, 2004: 137-150
24. Das S. Data Infrastructure at LinkedIn [C/OL]//Proc of the 5th Extremely Large Databases Conf. http://www-conf.slac.stanford.edu/xldb2011/talks/ xldb2011_tue_1005_LinkedIn.pdf. 2011
25. ScholarSpace [EB/OL]. [2012-10-02]. http://www.cdblp.cn/
26. Haas L. Integrating Extremely Large Data is Extremely Challenging [C/OL]//Proc of XLDB Asia 2012. http://idke.ruc.edu.cn/xldb/www.xldb-asia.org/program.html
27. Rajaraman A, Jeff Ullman. Mining of Massive Datasets [M/OL]. [2012-10-02]. http://i.stanford.edu/ullman/mmds.html.
28. Chapman A, Allen M D, Blaustein B. It's About the Data: Provenance as a Tool for Assessing Data Fitness [C]//Proc of the 4th USENIX Workshop on the Theory and Practice of Provenance. Berkeley, CA: USENIX Association, 2012
29. Hadoop [EB/OL]. [2012-10-02]. http://hadoop.apache.org/index.html
30. Ghemawat S, Gobioff H, Leung S T. The Google file system [C]//Proc of SOSP 2003. New York: ACM, 2003: 29-43
31. McKusick K, Quinlan S. GFS: Evolution on fast-forward [J]. Communication of ACM, 2010, 53(3): 42-49
32. Chaiken R, Jenkins B, Larson P-Å, et al. SCOPE: Easy and efficient parallel processing of massive data sets [J]. PVLDB, 2008, 1(2): 1265-1276
33. HDFS Architecture Guide [EB/OL]. [2012-10-02]. http://hadoop.apache.org/docs/hdfs/r0.22.0/hdfs_design.html
34. CloudStore [EB/OL]. [2012-10-02]. http://code.google.com/p/kosmosfs/
35. Beaver D, Kumar S, Li H C, et al. Finding a Needle in Haystack: Facebook's Photo Storage [C]//Proc of OSDI 2010. Berkeley, CA: USENIX Association, 2010: 47-60
36. TFS [EB/OL]. [2012-10-02]. http://code.taobao.org/p/tfs/wiki/index/
37. FastDFS [EB/OL]. [2012-10-02]. http://code.google.com/p/fastdfs/w/list
38. Brewer E A. Towards robust distributed systems (Invited Talk) [C]//Proc of PODC 2000. New York: ACM, 2000
39. Chang F, Dean J, Ghemawat S, et al. Bigtable: A distributed storage system for structured data [C]//Proc of OSDI 2006. Berkeley, CA: USENIX Association, 2006: 205-218
40. DeCandia G, Hastorun D, Jampani M, et al. Dynamo: Amazon's highly available key-value store [C]//Proc of SOSP 2007. New York: ACM, 2007: 205-220
41. Cooper B F, Ramakrishnan R, Srivastava U, et al. PNUTS: Yahoo!'s hosted data serving platform [J]. PVLDB, 2008, 1(2): 1277-1288
42. NOSQL Databases [EB/OL]. [2012-10-02]. http://nosql-database.org/
43. Strauch C. NoSQL Databases [EB/OL]. [2012-10-02]. http://www.christof-strauch.de/nosqldbs.pdf
44. Baker J, Bond C, Corbett J, et al. Megastore: Providing Scalable, Highly Available Storage for Interactive Services [C]//Proc of CIDR. 2011: 223-234
45. Corbett J C, Dean J, Epstein M, et al. Spanner: Google's globally-distributed database [C/OL]//Proc of OSDI 2012. Berkeley, CA: USENIX Association, 2012. [2012-10-10]. http://static.googleusercontent.com/external_content/untrusted_ dlcp/research.google.com/zh-CN//archive/spanner-osdi2012.pdf
46. Shute J, Oancea M, Ellner S, et al. F1: The fault-tolerant distributed RDBMS supporting google's ad business [C]//Proc of SIGMOD 2012. New York: ACM, 2012: 777-778
47. Peng D, Dabek F. Large-scale incremental processing using distributed transactions and notifications [C]//Proc of OSDI 2010. Berkeley, CA: USENIX Association, 2010: 1-15
48. Iyer S C, Utts M. Help test some next-generation infrastructure [EB/OL]. [2012-10-02]. http://googleweb mastercentral.blogspot.com/2009/08/help-test-some-next-generation. html, 2009
49. Wang Haixun. KDD summer school, 2012. Managing and Mining Billion-Node Graphs [EB/OL]. [2012-10-02]. http://kdd2012.sigkdd.org/sites/images/summerschool/Haixun-Wang.pdf
50. ITHbase. [EB/OL]. [2012-10-02]. https://github.com/hbase-trx/hbase-transactional-tableindexed
51. IHbase. [EB/OL]. [2012-10-02]. http://github.com/ykulbak/ihbase
52. Zou Yongqiang, Liu Jia, Wang Shicai, et al. CCIndex: A complemental clustering index on distributed ordered tables for multi-dimensional range queries [C]//Proc of NPC 2010. Berlin: Springer, 2010: 247-261
53. Agrawal P, Silberstein A, Cooper B F, et al. Asynchronous view maintenance for VLSD databases [C]//Proc of SIGMOD 2009. New York: ACM, 2009: 179-192
54. Wang Jinbao, Wu Sai, Gao Hong, et al. Indexing multi-dimensional data in a cloud system [C]//Proc of SIGMOD 2010. New York: ACM, 2010: 591-602
55. Ding Linlin, Qiao Baiyou, Wang Guoren, et al. An efficient quad-tree based index structure for cloud data management [C]//Proc of WAIM 2011. Berlin: Springer, 2011: 238-250
56. Zhang Xiangyu, Ai Jing, Wang Zhongyuan, et al. An efficient multi-dimensional index for cloud data management [C]//Proc of CloudDB 2009. New York: ACM, 2009: 17-24
57. Papadopoulos A, Katsaros D. A-Tree: Distributed indexing of multidimensional data for cloud computing environments [C]//Proc of CloudCom 2011. Piscataway, NJ: IEEE, 2011: 407-414
58. Nishimura S, Das S, Agrawal D, et al. MD-HBase: A scalable multi-dimensional data infrastructure for location aware services [C]//Proc of MDM 2011. Piscataway, NJ: IEEE, 2011: 7-16
59. Ma Youzhong, Rao Jia, Hu Weisong, et al. An efficient index for massive IOT data in cloud environment [C]//Proc of CIKM 2012. New York: ACM, 2012
60. Malewicz G, Austern M H, Bik A J C, et al. Pregel: A system for large-scale graph processing [C]//Proc of SIGMOD 2010. New York: ACM, 2010: 135-146
61. Leslie G. Valiant: A bridging model for parallel computation [J]. Communication of ACM, 1990, 33(8): 103-111
62. Melnik S, Gubarev A, Long Jingjing, et al. Dremel: Interactive analysis of web-scale datasets [J]. PVLDB, 2010, 3(1): 330-339
63. Google BigQuery. [EB/OL]. [2012-10-02]. https://cloud.google.com/products/big-query.html
64. Hall A, Bachmann O, Büssow R, et al. Processing a trillion cells per mouse click [J]. PVLDB, 2012, 5(11): 1436-1446
65. Isard M, Budiu M, Yu Yuan, et al. Dryad: Distributed data-parallel programs from sequential building blocks [C]//Proc of EuroSys 2007. New York: ACM, 2007: 59-72
66. Cascading. [EB/OL]. [2012-10-02]. http://www.cascading.org/
67. Gu Y, Grossman R L. Sector and sphere: The design and implementation of a high-performance data cloud [J]. Philosophical Transactions of the Royal Society A: Physical, Mathematical and Engineering Sciences, 2009, 367(1897): 2429-2445
68. Battré D, Ewen S, Hueske F, et al. Nephele/PACTs: A programming model and execution framework for web-scale analytical processing [C]//Proc of SoCC 2010. New York: ACM, 2010: 119-130
69. Gunda P K, Ravindranath L, Thekkath C A, et al. Nectar: Automatic management of data and computation in datacenters [C]//Proc of OSDI 2010. Berkeley, CA: USENIX Association, 2010: 75-88
70. Popa L, Budiu M, et al. DryadInc: Reusing work in large-scale computations [C]//Proc of HotCloud 2009. Berkeley, CA: USENIX Association, 2009
71. Bhatotia P, Wieder A, Rodrigues R, et al. Incoop: MapReduce for incremental computations [C]//Proc of SOCC 2011. New York: ACM, 2011
72. Yan Cairong, Yang Xin, Yu Ze, et al. IncMR: Incremental data processing based on MapReduce [C]//Proc of Cloud 2012. Piscataway, NJ: IEEE, 2012: 534-541
73. Olston C, Chiou G, Chitnis L, et al. Nova: Continuous Pig/Hadoop workflows [C]//SIGMOD 2011. New York: ACM, 2011: 1081-1090
74. Condie T, Conway N, Alvaro P, et al. MapReduce Online [C]//Proc of NSDI 2010. Berkeley, CA: USENIX Association, 2010: 313-328
75. Shi Yingjie, Meng Xiaofeng, Wang Fusheng, et al. You can stop early with COLA: Online processing of aggregate queries in the cloud [C]//Proc of CIKM 2012. New York: ACM, 2012
76. Logothetis D, Trezzo C, Webb K, et al. In-situ mapreduce for log processing [C]//Proc of USENIX ATC 2011. Berkeley, CA: USENIX Association, 2011
77. Trezzo C J. Continuous mapreduce: An architecture for large-scale in-situ data processing [D]. USA: University of California, San Diego, 2010. http://christrezzo.com/ctrezzo-thesis.pdf
78. Bu Yingyi, Howe B, Balazinska M, et al. HaLoop: Efficient iterative data processing on large clusters [J]. PVLDB, 2010, 3(1): 285-296
79. Ekanayake J, Li Hui, Zhang Bingjing, et al. Twister: A runtime for iterative MapReduce [C]//Proc of HPDC 2010. New York: ACM, 2010: 810-818
80. Zhang Y, Gao Q, Gao L, et al. iMapReduce: A distributed computing framework for iterative computation [C]//Proc of IPDPS 2011 DataCloud Workshop. Piscataway, NJ: IEEE, 2011: 1112-1121
81. Elnikety E, Elsayed E, Ramadan H E. iHadoop: Asynchronous iterations for mapreduce [C]//Proc of CloudCom 2011. Piscataway, NJ: IEEE, 2011: 81-90
82. Zhang Yanfeng, Gao Qixin, Gao Lixin, et al. PrIter: A distributed framework for prioritized iterative computations [C]//Proc of SoCC 2011. New York: ACM, 2011: 1-14
83. Zaharia M, Chowdhury M, Franklin M, et al. Spark: Cluster computing with working sets [C]//Proc of HotCloud 2010. Berkeley, CA: USENIX Association, 2010
84. Borthakur D, Gray J, Sarma J S, et al. Apache hadoop goes realtime at Facebook [C]//Proc of SIGMOD 2011. New York: ACM, 2011: 1071-1080
85. Mazur E, Li Boduo, Diao Yanlei, et al. Towards scalable one-pass analytics using MapReduce [C]//Proc of IPDPS Workshops 2011. Piscataway, NJ: IEEE, 2011: 1102-1111
86. Li Boduo, Mazur E, Diao Yanlei, et al. A platform for scalable one-pass analytics using MapReduce [C]//Proc of SIGMOD 2011. New York: ACM, 2011: 985-996
87. Kumar V, Andrade H, Gedik B, et al. DEDUCE: At the intersection of MapReduce and stream processing [C]//Proc of EDBT 2010. New York: ACM, 2010: 657-662
88. Backman N, Pattabiraman K, Fonseca R, et al. C-MR: Continuously executing MapReduce workflows on multi-core processors [C]//Proc of the 3rd Int Workshop on MapReduce and Its Applications. New York: ACM, 2012: 1-8
89. Aly A M, SallamA, Gnanasekaran B M, et al. M3: Stream processing on main-memory MapReduce [C]//Proc of ICDE 2012. Piscataway, NJ: IEEE, 2012: 1253-1256
90. Brito A, Martin A, Knauth T, et al. Scalable and low-latency data processing with stream MapReduce [C]//Proc of CloudCom 2011. Piscataway, NJ: IEEE, 2011: 48-58
91. Wang Lam, Liu Lu, Prasad S, et al. Muppet: MapReduce-style processing of fast data [J]. PVLDB, 2012, 5(12): 1814-1825
92. Ogawa H, Nakada H, Takano R, et al. SSS: An implementation of key-value store based MapReduce framework [C]//Proc of CloudCom 2010. Piscataway, NJ: IEEE, 2010: 754-761
93. Zaharia M, Das T, Li H, et al. Discretized streams: An efficient and fault-tolerant model for stream processing on large clusters [C]//Proc of HotCloud 2012. Berkeley, CA: USENIX Association, 2012
94. Seo S, Jang I, Woo K, et al. HPMR: Prefetching and pre-shuffling in shared MapReduce computation environment [C]//Proc of CLUSTER 2009. Piscataway, NJ: IEEE, 2009: 1-8
95. Dittrich J, Quiané-Ruiz J-A, Jindal A, et al. Hadoop++: Making a yellow elephant run like a cheetah (without it even noticing) [J]. PVLDB, 2010, 3(1): 518-529
96. Babu S. Towards automatic optimization of MapReduce programs [C]//Proc of SoCC 2010. New York: ACM, 2010: 137-142
97. Shafer J, Rixner S, Cox A L. The Hadoop distributed filesystem: Balancing portability and performance [C]//Proc of ISPASS 2010. Piscataway, NJ: IEEE, 2010: 122-1
98. Lu Wei, Shen Yanyan, Chen Su, et al: Efficient processing of k nearest neighbor joins using MapReduce [J]. PVLDB, 2012, 5(10): 1016-1027
99. Zhang Xiaofei, Chen Lei, Wang Min. Efficient multi-way theta-join processing using MapReduce [J]. PVLDB, 2012, 5(11): 1184-1195
100. Pansare N, Borkar V R, Jermaine C, et al. Online aggregation for large MapReduce jobs [J]. PVLDB, 2011, 4(11): 1135-1145
101. Silva Y N, Reed J M. Exploiting MapReduce-based similarity joins [C]//Proc of SIGMOD 2012. New York: ACM, 2012: 693-696
102. Okcan I, Riedewald M. Processing theta-joins using MapReduce [C]//Proc of SIGMOD 2011. New York: ACM, 2011: 949-960
103. Afrati F N, Das S A, Menestrina D, et al. Fuzzy joins using MapReduce [C]//Proc of ICDE 2012. Piscataway, NJ: IEEE, 2012: 498-509
104. Gudmundsson G b, Amsaleg L, Jónsson B b. Distributed high-dimensional index creation using Hadoop, HDFS and C++ [C]//Proc of CBMI 2012. Piscataway, NJ: IEEE, 2012: 1-6
105. Liao Haojun, Han Jizhong, Fang Jinyun. Multi-dimensional index on Hadoop distributed file system [C]//Proc of NAS. Piscataway, NJ: IEEE, 2010: 240-249
106. Thusoo A, Sarma J S, Jain N, et al. Hive-A petabyte scale data warehouse using Hadoop [C]//Proc of ICDE 2010. Piscataway, NJ: IEEE, 2010: 996-1005
107. Abouzied A, Bajda-Pawlikowski K, Huang Jiewen, et al. HadoopDB in action: Building real world applications [C]//Proc of SIGMOD 2010. New York: ACM, 2010: 1111-1114
108. Chen Songting. Cheetah: A high performance, custom data warehouse on top of MapReduce [J]. PVLDB, 2010, 3(2): 1459-1468
109. Su Xueyuan, Swart G. Oracle in-database hadoop: When mapreduce meets RDBMS [C]//Proc of SIGMOD 2012. New York: ACM, 2012: 779-790
110. Özcan F, Hoa D, Beyer K S, et al. Emerging trends in the enterprise data analytics: Connecting Hadoop and DB2 warehouse [C]//Proc of SIGMOD 2011. New York: ACM, 2011: 1161-1164
111. Xu Yu, Kostamaa P, Gao Like. Integrating hadoop and parallel DBMs [C]//Proc of SIGMOD 2010. New York: ACM, 2010: 969-974
112. Yang Yan, Ni Xianhua, Wang Hongjun, et al. Parallel implementation of ant-based clustering algorithm based on Hadoop [C]//Proc of ICSI 2012. Berlin: Springer, 2012: 190-197
113. Yang Lai, Shi Zhongzhi, Xu L D, et al. DH-TRIE frequent pattern mining on Hadoop using JPA [C]//Proc of GrC 2011. Piscataway, NJ: IEEE, 2011: 875-878
114. Nair S, Mehta J. Clustering with Apache Hadoop [C]//Proc of ICWET 2011. New York: ACM, 2011: 505-509
115. Yang Lai, Shi Zhongzhi. An efficient data mining framework on Hadoop using Java persistence API [C]//Proc of CIT 2010. Piscataway, NJ: IEEE, 2010: 203-209
116. Chiky R, Ghisloti R, Kazi-Aoul Z. Development of a distributed recommender system using the Hadoop framework [C]//Proc of EGC. 2012: 495-500
117. Jiang Jing, Lu Jie, Zhang Guangquan, et al. Scaling-up item-based collaborative filtering recommendation algorithm based on Hadoop [C]//Proc of SERVICES 2011. Piscataway, NJ: IEEE, 2011: 490-497
118. De Pessemier T, Vanhecke K, Dooms S, et al. Content-based recommendation algorithms on the Hadoop MapReduce framework [C]//Proc of WEBIST 2011. New York: ACM, 2011: 237-240
119. Perlich C, Dalessandro B, Hook R, et al. Bid optimizing and inventory scoring in targeted online advertising [C]//Proc of KDD 2012. New York: ACM, 2012: 804-812
120. Agrawal R, Srikant R. Privacy preserving data mining [C]//Proc of SIGMOD 2000. New York: ACM, 2000: 439-450
121. Dwork C. Differential privacy [C]//Proc of ICALP 2006. Berlin: Springer, 2006: 1-12
122. Härder T, Hudlet V, Ou Y, et al. Energy efficiency is not enough, energy proportionality is needed! [C]//Proc of DASFAA 2011. Berlin: Springer, 2011: 226-239
123. Times N Y. Power, Pollution and the Internet [EB/OL]. [2012-10-02]. http://www.nytimes.com/2012/09/23/technology/data-centers-waste- vast-amounts-of-energy-belying-industry-image.html?pagewanted=all
124. Chen Cheng, He Bingsheng, Tang Xueyan, et al. Green databases through integration of renewable energy [C/OL].//Proc of CIDR 2013. [2012-10-02]. http://www.cidrdb.org/2013
125. Lee S-W, Moon B. Design of flash-based DBMS: An in-page logging approach [C]//Proc of SIGMOD 2007. New York: ACM, 2007: 55-66
126. Soundararajan G, Prabhakaran V, Balakrishnan M, et al. Extending SSD lifetimes with disk-based write caches [C]//Proc of FAST 2010, Berkeley, CA: USENIX Association, 2010
127. Yang Puyuan, Jin Peiquan, Yue Lihua. Hybrid storage with disk based write cache [C]//Proc of FlashDB 2011. Berlin: Springer, 2011: 190-201
128. Koltsidas I, Viglas S D. Flashing up the storage layer [J]. PVLDB, 2008, 1(1): 514-525
129. Yang Qing, Ren Jin. I-CASH: Intelligently coupled array of SSD and HDD [C]//Proc of HPCA 2011. Piscataway, NJ: IEEE, 2011: 278-289
130. Chen Feng, Koufaty D A, Zhang Xiaodong. Hystor: Making the best use of solid state drives in high performance storage systems [C]//Proc of ICS 2011. New York: ACM, 2011: 22-32
131. Payer H, Sanvido M A, Bandic Z Z, et al. Combo drive: Optimizing cost and performance in a heterogeneous storage device [C]//Proc of WISH 2009. New York: ACM, 2009
132. Zhang Ning, Tatemura Junichi, Patel J M, et al. Towards cost-effective storage provisioning for DBMSs [J]. PVLDB, 2011, 5(4): 274-285
133. Canim M, Mihaila G A, Bhattacharjee B, et al. SSD bufferpool extensions for database systems [J].PVLDB, 2010, 3(1/2): 1435-1446
134. Do Jaeyoung, Zhang Donghui, Patel Jignesh M, et al. Turbocharging DBMS buffer pool using SSDs [C]//Proc of SIGMOD 2011. New York: ACM, 1113-1124
135. Ou Y, Härder T. Improving database performance using a flash-based write cache [C]//Proc of Proc of FlashDB 2011. Berlin: Springer, 2012: 2-13
136. Luo T, Lee R, Mesnier M, et al. hStorage-DB: Heterogeneity-aware data management to exploit the full capability of hybrid storage systems [J]. PVLDB, 2012, 5(10): 1076-1087
137. Kang W-H, Lee S-W, Moon B. Flash-based extended cache for higher throughput and faster recovery [J]. PVLDB, 2012, 5(11): 1615-1626
138. Norman D A. The Design of Everyday Things [M]. New York: Basic Books, 2002
139. Babu S. Towards automatic optimization of MapReduce programs [C]//Proc of SoCC 2010. New York: ACM, 2010: 137-142
140. Jahani E, Cafarella M J, Ré C. Automatic optimization for MapReduce programs [J]. PVLDB, 2011, 4(6): 385-396
141. Cafarella M J, Ré C. Manimal: Relational optimization for data-intensive programs [C]//Proc of WebDB 2010. New York: ACM, 2010
142. Herodotou H, Lim H, Luo G, et al. Starfish: A self-tuning system for big data analytics [C]//Proc of CIDR. 2011: 261-272
143. Wong P C, Shen H-W, Johnson C R, et al. The top 10 challenges in extreme-scale visual analytics [J]. Computer Graphics and Applications, 2012, 32(4): 63-67
144. Olston C, Reed B, Srivastava U, et al. Pig Latin: A not-so-foreign language for data processing [C]//Proc of SIGMOD 2008. New York: ACM, 2008: 1099-1110
145. Pike R, Dorward S, Griesemer R, et al. Interpreting the data: Parallel analysis with Sawzall [J]. Scientific Programming, 2005, 13(4): 277-298
146. Isard M, Yu Y. Distributed data-parallel computing using a high-level programming language [C]//Proc of SIGMOD 2009. New York: ACM, 2009: 987-994
147. Fegaras L, Li C, Gupta U, et al. XML query optimization in MapReduce [C]//Proc of WebDB 2011. New York: ACM, 2011
148. Iu M-Y, Zwaenepoel W. HadoopToSQL: A MapReduce query optimizer [C]//Proc of EuroSys 2010. New York: ACM, 2010: 251-264
149. Fegaras L, Li C, Gupta U. An optimization framework for map-reduce queries [C]//Proc of EDBT 2012. New York: ACM, 2012: 26-37
150. He Bingsheng, Yang Mao, Guo Zhenyu, et al. Comet: Batched stream processing for data intensive distributed computing [C]//Proc of SoCC 2010. New York: ACM, 2010: 63-74
151. Lee R, Luo Tian, Huai Yin, et al. YSmart: Yet another SQL-to-MapReduce translator. [C]//Proc of ICDCS 2011. Piscataway, NJ: IEEE, 2011: 25-36
152. Chattopadhyay B, Lin Liang, Liu Weiran, et al. Tenzing a SQL implementation on the MapReduce framework [J]. PVLDB, 2011, 4(12): 1318-1327
153. Stoellberger P. S4Latin: Language-based big data streaming [D/OL]. UK: University of Edinburgh, 2011. [2012-10-02]. http://analytical-labs.com/downloads/msc_BigDataStreams.pdf
154. Morton K, Balazinska M, Grossman D. ParaTimer: A progress indicator for MapReduce DAGs [C]//Proc of SIGMOD 2010. New York: ACM, 2010: 507-518
155. Morton K, Friesen A, Balazinska M, et al. KAMD: Estimating the progress of MapReduce pipelines [C]//Proc of ICDE 2010. Piscataway, NJ: IEEE, 2010: 681-684
156. Huang Dachuan, Shi Xuanhua, Ibrahim Shadi, et al. MR-scope: A real-time tracing tool for MapReduce [C]//Proc of HPDC 2010. New York: ACM, 2010: 849-855
157. Tan Jiaqi, Kavulya S, Gandhi R, et al. Visual, log-based causal tracing for performance debugging of MapReduce systems [C]//Proc of ICDCS 2010. Piscataway, NJ: IEEE, 2010: 795-806
158. Khoussainova N, Balazinska M, Suciu D. PerfXplain: Debugging MapReduce job performance [J]. PVLDB, 2012, 5(7): 598-609
159. Dai Jinquan, Huang Jie, Huang Shengsheng, et al. HiTune: Dataflow-based performance analysis for big data cloud [C]//Proc of USENIX ATC 2011. Berkeley, CA: USENIX Association, 2011
160. Baru C, Bhandarkar M, Nambiar R, et al. Introducting the big data benchmarking community [EB/OL]//Proc of XLDB 2012. [2012-10-02]. http://www-conf.slac.stanford.edu/xldb2012/talks/xldb2012_tue_ LT07_Baru_etal.pdf
161. Chen Y. We don't know enough to make a big data benchmark suite-An academia-industry view [R/OL]. Berkeley: EECS Department, University of California, http://www.eecs.berkeley.edu/Pubs/TechRpts/2012/EECS-2012-71.pdf
162. Chen Yanpei, Ganapathi A, Griffith R, et al. The case for evaluating MapReduce performance using workload suites [C]//Proc of MASCOTS 2011. Piscataway, NJ: IEEE, 2011: 390-399
163. Sangroya A, Serrano D, Bouchenak S. MRBS: A comprehensive MapReduce benchmark suite [R/OL]. LIG Laboratory, University of Grenoble. [2012-10-02]. http://rr.liglab.fr/research_report/RR-LIG-024_orig.pdf
164. GridMix. [EB/OL]. [2012-10-02]. http://hadoop.apache.org/docs/mapreduce/current/gridmix.html
165. TPC-DS. [EB/OL]. [2012-10-02]. http://www.tpc.org/tpcds/
166. Patil S, Polte M, Ren K, et al. YCSB++: Benchmarking and performance debugging advanced features in scalable table stores [C]//Proc of SoCC 2011. New York: ACM, 2011
167. Chen Y, Alspaugh S, Katz R. Interactive query processing in big data systems: A cross-industry study of MapReduce workloads [J]. PVLDB, 2012, 5(12): 1802-1813