Multimedia applications and security in MapReduce: Opportunities and challenges

Concurrency and Computation: Practice and Experience

Volumn 24, Issue 17, 2012, Pages 2083-2101

  Yu, Zhiwei ^a   Wang, Chaokun ^a   Thomborson, Clark ^b   Wang, Jianmin ^a   Lian, Shiguo ^c   Vasilakos, Athanasios V ^d  

^a TSINGHUA UNIVERSITY   (China)

^b UNIVERSITY OF AUCKLAND   (New Zealand)

^c HUAWEI TECHNOLOGIES CO LTD   (China)

^d UNIVERSITY OF WESTERN MACEDONIA   (Greece)

Author keywords

cloud computing; MapReduce; multimedia; security

Indexed keywords

COMPUTER APPLICATIONS; COMPUTER NETWORKS; CONCURRENCY CONTROL;

CLOUD-BASED; DISTRIBUTED STORAGE; ISSUES AND CHALLENGES; MAP-REDUCE; MULTIMEDIA; MULTIMEDIA APPLICATIONS; PROGRAMMING MODELS; SECURITY;

CLOUD COMPUTING;

EID: 84867309655     PISSN: 15320626     EISSN: 15320634     Source Type: Journal    
DOI: 10.1002/cpe.1846     Document Type: Article

References (86)

1. Armbrust M, et al,. Above the clouds: A Berkeley view of cloud computing. Technical Report UCB/EECS-2009-28, EECS Department, University of California, Berkeley, Febuary 2009.
2. Mell P, Grance T,. The NIST definition of cloud computing (draft): Recommendations of the National Institute of Standards and Technology. Technical Report 800-145, NIST, US Department of Commerce, Jan 2011.
3. Cloud Security Alliance. Security guidance for critical areas of focus, v2.1, 2009.
4. Subashini S, Kavitha V,. A survey on security issues in service delivery models of cloud computing. Journal of Network and Computer Applications 2011; 34 (1): 1-11.
5. Leavitt N,. Is cloud computing really ready for prime time? IEEE Computer 2009; 42 (1): 15-20.
6. Natis YV, et al,. Application infrastructure for cloud computing: A growing market. Technical Report G00175138, Gartner Research, Mar 2010.
7. Smith DM,. Hype cycle for cloud computing. Technical Report G00201557, Gartner Research, Jul 2010.
8. Rimal BP, Choi E, Lumb I,. A taxonomy, survey, and issues of cloud computing ecosystems. In Cloud Computing: Principles, Systems and Applications. Springer-Verlag: London Limited, 2010; 21-46.
9. Dahbur K, Mohammad B, Tarakji AB,. A survey of risks, threats and vulnerabilities in cloud computing. Proceedings of the 2011 International Conference on Intelligent Semantic Web-Services and Applications, ISWSA '11, ACM: New York, NY, USA, 2011; 12:1-12:6, DOI: 10.1145/1980822.1980834.
10. Hu F, Qiu M, Li J, Grant T, Tylor D, McCaleb S, Butler L, Hamner R,. A review on cloud computing: Design challenges in architecture and security. Journal of Computing and Information Technology 2011: 25-55.
11. Hadoop. http://hadoop.apache.org/ [Accessed on August 12, 2011].
12. Foster I, Zhao Y, Raicu I, Lu S,. Cloud computing and grid computing 360-degree compared. Grid Computing Environments Workshop (GCE '08), Nov 2008; 1-10, DOI: 10.1109/GCE.2008.4738445.
13. Dean J, Ghemawat S,. MapReduce: Simplified data processing on large clusters. OSDI, 2004; 137-150.
14. apache.org/hadoop/poweredby. http://wiki.apache.org/hadoop/PoweredBy.
15. Pavlo A, Paulson E, Rasin A, Abadi DJ, DeWitt DJ, Madden S, Stonebraker M,. A comparison of approaches to large-scale data analysis. SIGMOD Conference, 2009; 165-178.
16. Abouzeid A, Bajda-Pawlikowski K, Abadi DJ, Rasin A, Silberschatz A,. HadoopDB: An architectural hybrid of MapReduce and DBMS technologies for analytical workloads. PVLDB 2009; 2 (1): 922-933.
17. Dittrich J, Quiané-Ruiz JA, Jindal A, Kargin Y, Setty V, Schad J,. Hadoop++: Making a yellow elephant run like a cheetah (without it even noticing). PVLDB 2010; 3 (1): 518-529.
18. Jahani E, Cafarella MJ, Ré C,. Automatic optimization for MapReduce programs. PVLDB 2011; 4 (6): 385-396.
19. Thusoo A, Sarma JS, Jain N, Shao Z, Chakka P, Anthony S, Liu H, Wyckoff P, Murthy R,. Hive: A warehousing solution over a map-reduce framework. Proceedings of the VLDB Endowment 2009; 2: 1626-1629.
20. Gates A, Natkovich O, Chopra S, Kamath P, Narayanam S, Olston C, Reed B, Srinivasan S, Srivastava U,. Building a highlevel dataflow system on top of MapReduce: The pig experience. PVLDB 2009; 2 (2): 1414-1425.
21. Olston C, Reed B, Srivastava U, Kumar R, Tomkins A,. Pig latin: A not-so-foreign language for data processing. SIGMOD Conference, 2008; 1099-1110.
22. Zaharia M, Konwinski A, Joseph AD, Katz RH, Stoica I,. Improving MapReduce performance in heterogeneous environments. OSDI, 2008; 29-42.
23. Condie T, Conway N, Alvaro P, Hellerstein JM, Elmeleegy K, Sears R,. MapReduce online. NSDI, 2010; 313-328.
24. Bu Y, Howe B, Balazinska M, Ernst M,. Haloop: Efficient iterative data processing on large clusters. PVLDB 2010; 3 (1): 285-296.
25. Lämmel R,. Google's MapReduce programming model-revisited. Science of Computer Programming 2008; 70 (1): 1-30.
26. Leiserson CE, Abuhamdeh ZS, Douglas DC, Feynman CR, Ganmukhi MN, Hill JV, Hillis WD, Kuszmaul BC, Pierre MAS, Wells DS, et al,. The network architecture of the Connection Machine CM-5. Journal of Parallel and Distributed Computing 1996; 33 (2): 145-158. DOI: 10.1006/jpdc.1996.0033.
27. Blelloch GE, Hardwick JC, Sipelstein J, Zagha M, Chatterjee S,. Implementation of a portable nested data-parallel language. Journal of Parallel and Distributed Computing 1994; 21 (1): 4-14. DOI: 10.1006/jpdc.1994.1038.
28. eXtreme Computing Group M. Daytona-Developer Guide, July 2011. http://research.microsoft.com/en-us/projects/azure/daytona.aspx [Accessed on September 16, 2011].
29. Lin J, Dyer C,. Data intensive text processing with MapReduce, 2010.
30. Elsayed T, Lin JJ, Oard DW,. Pairwise document similarity in large collections with MapReduce. ACL (Short Papers), 2008; 265-268.
31. Wang C, Wang J, Lin X, Wang W, Wang H, Li H, Tian W, Xu J, Li R,. MapDupReducer: Detecting near duplicates over massive datasets. Proceedings of the 2010 International Conference on Management of Data, SIGMOD '10, ACM: New York, NY, USA, 2010; 1119-1122, DOI: 10.1145/1807167.1807296.
32. Li R, Ju L, Peng Z, Yu Z, Wang C,. Batch text similarity search with MapReduce. To appear, 13th International Asia-Pacific Web Conference (APWeb), 2011.
33. Gao H, Jiang J, She L, Fu Y,. A new agglomerative hierarchical clustering algorithm implementation based on the map reduce framework. International Journal of Digital Content Technology and its Applications 2010; 95-100.
34. Lin JJ,. Is searching full text more effective than searching abstracts? BMC Bioinformatics 2009; 10. DOI: 10.1186/1471-2105-10-46.
35. Yan R, Fleury M-O, Merler M, Natsev A, Smith JR,. Large-scale multimedia semantic concept modeling using robust subspace bagging and MapReduce. Proceedings of the First ACM Workshop on Large-scale Multimedia Retrieval and Mining, LS-MMRM '09, ACM: New York, NY, USA, 2009; 35-42, DOI: 10.1145/1631058.1631067.
36. Chen CW, Li Z, Lian S, (eds). Intelligent Multimedia Communication: Techniques and Applications, Studies in Computational Intelligence, Vol. 280. Springer-Verlag: Berlin Heidelberg, 2010. DOI: 10.1007/978-3-642-11756-5.
37. Lai CF, Vasilakos AV,. Mobile multimedia services over cloud computing. E-Letter 2010; 5 (6). Multimedia Communications Technical Committee, IEEE Communications Society.
38. Yang Z, Kamata S, Ahrary A,. Nir: Content based image retrieval on cloud computing. Intelligent Computing and Intelligent Systems, 2009. ICIS 2009. IEEE International Conference on, Vol. 3, 2009; 556-559, DOI: 10.1109/ICICISYS.2009. 5358101.
39. Chang FC, Huang HC,. A programming model for distributed content-based image retrieval. Intelligent Information Hiding and Multimedia Signal Processing, 2007. IIHMSP 2007. Third International Conference on, Vol. 1, 2007; 210-213, DOI: 10.1109/IIH-MSP.2007.54.
40. Platt J,. Sequential minimal optimization: A fast algorithm for training support vector machines. Advances in Kernel Methods: Support Vector Learning 1998; 208 (MSR-TR-98-14): 1-21.
41. Catanzaro B, Sundaram N, Keutzer K,. Fast support vector machine training and classification on graphics processors. Proceedings of the 25th International Conference on Machine Learning (ICML 2008), Helsinki, Finland, 2008; 104-111.
42. Alham N, Li M, Hammoud S, Liu Y, Ponraj M,. A distributed SVM for image annotation. Fuzzy Systems and Knowledge Discovery (FSKD), 2010 Seventh International Conference on, Vol. 6, 2010; 2983-2987, DOI: 10.1109/FSKD.2010. 5569084.
43. Liu T, Rosenberg C, Rowley HA,. Clustering billions of images with large scale nearest neighbor search. Proceedings of the Eighth IEEE Workshop on Applications of Computer Vision, WACV '07, IEEE Computer Society: Washington, DC, USA, 2007; 28 -, DOI: 10.1109/WACV.2007.18.
44. Lv Z, Hu Y, Zhong H, Wu J, Li B, Zhao H,. Parallel k-means clustering of remote sensing images based on MapReduce. In WISM, Lecture Notes in Computer Science, Vol. 6318, Wang FL, Gong Z, Luo X, Lei J, (eds). Springer, 2010; 162-170.
45. Li B, Zhao H, Lv Z,. Parallel isodata clustering of remote sensing images based on MapReduce. Cyber-Enabled Distributed Computing and Knowledge Discovery (CyberC), 2010 International Conference on, 2010; 380-383, DOI: 10.1109/CyberC.2010.75.
46. Liu K, et al,. A distributed parallel image analysis platform with MapReduce integration. Technical Report HPL-2010-71, HP Labs, July 2010.
47. Cary A, Sun Z, Hristidis V, Rishe N,. Experiences on processing spatial data with MapReduce. Proceedings of the 21st International Conference on Scientific and Statistical Database Management, SSDBM 2009, Springer-Verlag: Berlin, Heidelberg, 2009; 302-319.
48. White B, Yeh T, Lin J, Davis L,. Web-scale computer vision using MapReduce for multimedia data mining. Proceedings of the Tenth International Workshop on Multimedia Data Mining, MDMKDD '10, ACM: New York, NY, USA, 2010; 9:1-9:10, DOI: 10.1145/1814245.1814254.
49. He B, Fang W, Luo Q, Govindaraju NK, Wang T,. Mars: A MapReduce framework on graphics processors. PACT, 2008; 260-269.
50. Shimin Chen SWS,. Map-reduce meets wider varieties of applications. Technical Report, May 2008.
51. Bennett J, Lanning S, Netflix N,. The netflix prize. In KDD Cup and Workshop in conjunction with KDD, 2007.
52. Akcelik V, Bielak J, Biros G, Epanomeritakis I, Fernandez A, Ghattas O, Kim EJ, Lopez J, O'Hallaron D, Tu T, et al,. High resolution forward and inverse earthquake modeling on terascale computers. Proceedings of the 2003 ACM/IEEE Conference on Supercomputing, SC '03, IEEE Computer Society: Washington, DC, USA, 2003; 52 -.
53. Beaufays F, Vanhoucke V, Strope B,. Unsupervised discovery and training of maximally dissimilar cluster models. In 11th Annual Conference of the International Speech Communication Association (INTERSPEECH 2010), Kobayashi T, Hirose K, Nakamura S, (eds). ISCA, 2010; 66-69.
54. Jehan T, Lamere P, Whitman B,. Music retrieval from everything. Proceedings of the international conference on Multimedia information retrieval, MIR '10, ACM: New York, NY, USA, 2010; 245-246, DOI: 10.1145/1743384.1743428. URL http://doi.acm.org/10.1145/1743384.1743428.
55. Yoshii K, Goto M,. Continuous PLSI and smoothing techniques for hybrid music recommendation. ISMIR 2009, 2009; 339-344.
56. Zhao Z, Wang X, Xiang Q, Sarroff AM, Li Z, Wang Y,. Large-scale music tag recommendation with explicit multiple attributes. ACM Multimedia, 2010; 401-410.
57. Liu KY, Zhang T, Wang L,. A new parallel video understanding and retrieval system. ICME, 2010; 679-684.
58. Sebastine SC, Thuraisingham BM, Prabhakaran B,. Semantic web for content based video retrieval. ICSC, 2009; 103-108.
59. Baluja S, Seth R, Sivakumar D, Jing Y, Yagnik J, Kumar S, Ravichandran D, Aly M,. Video suggestion and discovery for youtube: Taking random walks through the view graph. WWW, 2008; 895-904.
60. Jin Y, Hu M, Singh H, Xie Z,. Myspace video recommendation with map-reduce on qizmt 2010.
61. Pereira R, Azambuja M, Breitman K, Endler M,. An architecture for distributed high performance video processing in the cloud. IEEE International Conference on Cloud Computing 2010; 0: 482-489. DOI: 10.1109/CLOUD.2010.73.
62. Cohen J,. Graph twiddling in a MapReduce world. Computing in Science and Engineering 2009; 11 (4): 29-41.
63. Malewicz G, Austern MH, Bik AJ, Dehnert JC, Horn I, Leiser N, Czajkowski G,. Pregel: A system for large-scale graph processing. Proceedings of the 2010 International Conference on Management of Data, SIGMOD '10, ACM: New York, NY, USA, 2010; 135-146, DOI: 10.1145/1807167.1807184.
64. Rao D, Yarowsky D,. Ranking and semi-supervised classification on large scale graphs using map-reduce. Proceedings of the 2009 Workshop on Graph-based Methods for Natural Language Processing, TextGraphs-4, Association for Computational Linguistics: Stroudsburg, PA, USA, 2009; 58-65.
65. Choi H, Son J, Cho Y, Sung MK, Chung YD,. SPIDER: A system for scalable, parallel / distributed evaluation of large-scale RDF data. CIKM, 2009; 2087-2088.
66. Husain MF, Doshi P, Khan L, Thuraisingham BM,. Storage and retrieval of large RDF graph using Hadoop and MapReduce. CloudCom, 2009; 680-686.
67. Kang U, Tsourakakis CE, Faloutsos C,. Pegasus: A peta-scale graph mining system implementation and observations. Proceedings of the 2009 Ninth IEEE International Conference on Data Mining. ICDM '09, IEEE Computer Society: Washington, DC, USA, 2009; 229-238, DOI: 10.1109/ICDM.2009.14.
68. Lin J, Schatz M,. Design patterns for efficient graph algorithms in MapReduce. Proceedings of the Eighth Workshop on Mining and Learning with Graphs, MLG '10, ACM: New York, NY, USA, 2010; 78-85, DOI: 10.1145/1830252. 1830263.
69. Papadimitriou S, Sun J,. DisCo: Distributed co-clustering with map-reduce: A case study towards petabyte-scale end-to-end mining. ICDM, 2008; 512-521.
70. Lian S, Kanellopoulos D, Ruffo G,. Recent advances in multimedia information system security. Informatica (Slovenia) 2009; 33 (1): 3-24.
71. Cavoukian A,. Privacy in the clouds. Identity in the Information Society 2008; 1: 89-108. DOI: 10.1007/s12394-008-0005-z.
72. Gartner Global IT Council for Cloud Services. Rights and responsibilities for consumers of cloud computing services. Technical Report, Gartner Research, 2010.
73. Sencar HT, Velastin SA, Nikolaidis N, Lian S, (eds). Intelligent Multimedia Analysis for Security Applications, Studies in Computational Intelligence, Vol. 282. Springer-Verlag: Berlin Heidelberg, 2010. DOI: 10.1007/978-3-642-11756-5.
74. Lian S, Zhang Y,. Handbook of Research on Secure Multimedia Distribution, 1st. Information Science Reference-Imprint of: IGI Publishing: Hershey, PA, 2009.
75. Wei W, Du J, Yu T, Gu X,. SecureMR: A service integrity assurance framework for MapReduce. ACSAC, 2009; 73-82.
76. Roy I, Setty STV, Kilzer A, Shmatikov V, Witchel E,. Airavat: Security and privacy for MapReduce. NSDI, 2010; 297-312.
77. Dwork C,. Differential privacy. ICALP (2), 2006; 1-12.
78. McCarty B,. SELinux: NSA's Open Source Security Enhanced Linux. O'Reilly Media: Sebastopol, California, 2004.
79. Zhu H, Bao F,. Private searching on MapReduce. TrustBus, 2010; 93-101.
80. Zhou W, Sherr M, Marczak WR, Zhang Z, Tao T, Loo BT, Lee I,. Towards a data-centric view of cloud security. Proceedings of the Second International Workshop on Cloud Data Management, CloudDB '10, ACM: New York, NY, USA, 2010; 25-32, DOI: 10.1145/1871929.1871934.
81. Blumenthal MS,. Hide and seek in the cloud. IEEE Security & Privacy 2010; 8 (2): 57-58.
82. Ristenpart T, Tromer E, Shacham H, Savage S,. Hey, you, get off of my cloud: Exploring information leakage in third-party compute clouds. In ACM Conference on Computer and Communications Security, Al-Shaer E, Jha S, Keromytis AD, (eds). ACM: New York, NY, USA, 2009; 199-212.
83. Fu J, Wang C, Yu Z, Wang J, Sun JG,. A watermark-aware trusted running environment for software clouds. ChinaGrid Conference (ChinaGrid), 2010 Fifth Annual, 2010; 144-151, DOI: 10.1109/ChinaGrid.2010.15.
84. Wang C, Zou P, Liu Z, Wang J,. CS-DRM: A cloud-based SIM DRM scheme for mobile internet. EURASIP Journal on Wireless Communications and Networking 2011; 2011 (1).
85. Zou P, Wang C, Liu Z, Bao D,. Phosphor: A cloud based DRM scheme with SIM card. APWeb, 2010; 459-463.
86. Yu Z, Wang C, Thomborson C, Wang J, Lian S, Vasilakos A,. A novel watermarking method for software protection in the cloud. Software: Practice and Experience 2011, DOI: 10.1002/spe.1088.