Multiple two-phase data processing with MapReduce

IEEE International Conference on Cloud Computing, CLOUD

Volumn , Issue , 2014, Pages 352-359

  Wu, Hsiang Huang ^a   Yeh, Tse Chen ^a   Wang, Chien Min ^a  

^a INSTITUTE OF INFORMATION SCIENCE   (Taiwan)

Author keywords

Big data; Cloud computing; MapReduce

Indexed keywords

BIG DATA; CLOUD COMPUTING; LARGE DATASET; SECURITY SYSTEMS; TEXT PROCESSING;

BACKGROUND SUBTRACTION; DESIGN METHODOLOGY; DISTRIBUTED RESOURCES; MAP-REDUCE; MODELING PARADIGMS; PROGRAMMING MODELS; TWO-STAGE PROCESSING; VIDEO SURVEILLANCE;

DATA HANDLING;

EID: 84919794610     PISSN: 21596182     EISSN: 21596190     Source Type: Conference Proceeding    
DOI: 10.1109/CLOUD.2014.55     Document Type: Conference Paper

References (24)

1. J. Dean and S. Ghemawat, "MapReduce: Simplified Data Processing on Large Clusters," in Proceedings of the 6th conference on Symposium on Opearting Systems Design & Implementation-Volume 6, ser. OSDI'04. Berkeley, CA, USA: USENIX Association, 2004, pp. 10-10.
2. http://hadoop.apache.org/.
3. M. Stonebraker, D. Abadi, D. J. DeWitt, S. Madden, E. Paulson, A. Pavlo, and A. Rasin, "MapReduce and Parallel DBMSs: Friends or Foes?" Communications of the ACM, vol. 53, no. 1, pp. 64-71, 2010.
4. A. Pavlo, E. Paulson, A. Rasin, D. J. Abadi, D. J. DeWitt, S. Madden, and M. Stonebraker, "A Comparison of Approaches to Large-scale Data Analysis," in SIGMOD '09: Proceedings of the 35th SIGMOD international conference on Management of data. New York, NY, USA: ACM, 2009, pp. 165-178.
5. J. Dean and S. Ghemawat, "MapReduce: A Flexible Data Processing Tool," Commun. ACM, vol. 53, no. 1, pp. 72-77, Jan. 2010.
6. D. Jiang, B. C. Ooi, L. Shi, and S. Wu, "The performance of MapReduce: An In-depth Study," Proc. VLDB Endow., vol. 3, no. 1-2, pp. 472-483, Sep. 2010.
7. K. Ranganathan and I. Foster, "Decoupling Computation and Data Scheduling in Distributed Data-Intensive Applications," in High Performance Distributed Computing, 2002. HPDC-11 2002. Proceedings. 11th IEEE International Symposium on, 2002, pp. 352-358.
8. S. Ibrahim, H. Jin, L. Lu, B. He, G. Antoniu, and S. Wu, "Maestro: Replica-Aware Map Scheduling for MapReduce," in Proceedings of the 2012 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (ccgrid 2012), ser. CCGRID '12. Washington, DC, USA: IEEE Computer Society, 2012, pp. 435-442.
9. M. Zaharia, D. Borthakur, J. Sen Sarma, K. Elmeleegy, S. Shenker, and I. Stoica, "Delay Scheduling: A Simple Technique for Achieving Locality and Fairness in Cluster Scheduling," in Proceedings of the 5th European conference on Computer systems, ser. EuroSys '10. New York, NY, USA: ACM, 2010, pp. 265-278.
10. H. Jin, X. Yang, X.-H. Sun, and I. Raicu, "ADAPT: Availability-Aware MapReduce Data Placement for Non-Dedicated Distributed Computing," in 2012 IEEE 32nd International Conference on Distributed Computing Systems (ICDCS), 2012, pp. 516-525.
11. T.-T. Vu and F. Huet, "A Lightweight Continuous Jobs Mechanism for MapReduce Frameworks," IEEE International Symposium on Cluster Computing and the Grid, vol. 0, pp. 269-276, 2013.
12. C. Yan, X. Yang, Z. Yu, M. Li, and X. Li, "IncMR: Incremental Data Processing Based on MapReduce," 2012 IEEE Fifth International Conference on Cloud Computing, vol. 0, pp. 534-541, 2012.
13. H. Liu and D. Orban, "Cloud MapReduce: A MapReduce Implementation on Top of a Cloud Operating System," IEEE International Symposium on Cluster Computing and the Grid, vol. 0, pp. 464-474, 2011.
14. Z. Fadika and M. Govindaraju, "DELMA: Dynamically ELastic MapReduce Framework for CPU-Intensive Applications," IEEE International Symposium on Cluster Computing and the Grid, vol. 0, pp. 454-463, 2011.
15. J. A. Stuart, C.-K. Chen, K.-L. Ma, and J. D. Owens, "Multi-GPU Volume Rendering using MapReduce," in Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing, HPDC 2010, Chicago, Illinois, USA, June 21-25, 2010, S. Hariri and K. Keahey, Eds. ACM, 2010, pp. 841-848.
16. J. Tan, S. Kavulya, R. Gandhi, and P. Narasimhan, "Visual, Log-Based Causal Tracing for Performance Debugging of MapReduce Systems," in Proceedings of the 2010 IEEE 30th International Conference on Distributed Computing Systems, ser. ICDCS '10. Washington, DC, USA: IEEE Computer Society, 2010, pp. 795-806.
17. H. Karloff, S. Suri, and S. Vassilvitskii, "A Model of Computation for MapReduce," in Proceedings of the Twenty-First Annual ACM-SIAM Symposium on Discrete Algorithms, ser. SODA '10. Philadelphia, PA, USA: Society for Industrial and Applied Mathematics, 2010, pp. 938-948.
18. F. Halim, R. H. C. Yap, and Y. Wu, "A MapReduce-Based Maximum-Flow Algorithm for Large Small-World Network Graphs," in Proceedings of the 2011 31st International Conference on Distributed Computing Systems, ser. ICDCS '11. Washington, DC, USA: IEEE Computer Society, 2011, pp. 192-202.
19. J. Lin, A. Bahety, S. Konda, and S. Mahindrakar, "Low-Latency, High-Throughput Access to Static Global Resources within the Hadoop Framework," University of Maryland, College Park, Maryland, Tech. Rep. HCIL-2009-01, January 2009.
20. B. White, T. Yeh, J. Lin, and L. Davis, "Web-scale Computer Vision Using MapReduce for Multimedia Data Mining," in Proceedings of the Tenth International Workshop on Multimedia Data Mining, ser. MDMKDD '10. New York, NY, USA: ACM, 2010.
21. J. Lin and C. Dyer, Data-Intensive Text Processing with MapReduce, 2010.
22. S. Kavulya, J. Tan, R. Gandhi, and P. Narasimhan, "An Analysis of Traces from a Production MapReduce Cluster," in Proceedings of the 2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing, ser. CCGRID '10. Washington, DC, USA: IEEE Computer Society, 2010, pp. 94-103.
23. M. Piccardi, "Background Subtraction Techniques: A Review," in 2004 IEEE International Conference on Systems, Man and Cybernetics, vol. 4, 2004, pp. 3099-3104 vol.4.
24. C. Stauffer and W. E. L. Grimson, "Adaptive Background Mixture Models for Real-Time Tracking," in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1999.