MOON: MapReduce on opportunistic eNvironments

HPDC 2010 - Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing

Volumn , Issue , 2010, Pages 95-106

  Lin, Heshan ^a   Ma, Xiaosong ^b   Archuleta, Jeremy ^a   Feng, Wu Chun ^a   Gardner, Mark ^a   Zhang, Zhe ^b  

^a VIRGINIA POLYTECHNIC INSTITUTE AND STATE UNIVERSITY   (United States)

^b NORTH CAROLINA STATE UNIVERSITY   (United States)

Author keywords

Cloud computing; MapReduce; Volunteer computing

Indexed keywords

CLOUD COMPUTING; EASE-OF-USE; HARDWARE CONFIGURATIONS; LARGE DATASETS; MAP-REDUCE; OPEN SOURCE IMPLEMENTATION; PERFORMANCE IMPROVEMENTS; PROGRAMMING PARADIGMS; VOLUNTEER COMPUTING;

COMPUTER HARDWARE; COMPUTER SYSTEMS; DATA HANDLING; MOON; SCHEDULING ALGORITHMS;

CLUSTER COMPUTING;

EID: 78650029124     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1851476.1851489     Document Type: Conference Paper

References (25)

1. Hadoop. http://hadoop.apache.org/core/.
2. A. Adya, W. Bolosky, M. Castro, R. Chaiken, G. Cermak, J.Douceur, J. Howell, J. Lorch, M. Theimer, and R. Wattenhofer. FARSITE: Federated, available, and reliable storage for an incompletely trusted environment. In Proceedings of the 5th Symposium on Operating Systems Design and Implementation, 2002.
3. D. Anderson. Boinc: A system for public-resource computing and storage. Grid Computing, IEEE/ACM International Workshop on, 0, 2004.
4. Apple Inc. Xgrid. http://www.apple.com/server/macosx/technology/xgrid. html.
5. S. Chen and S. Schlosser. Map-reduce meets wider varieties of applications meets wider varieties of applications. Technical Report IRP-TR-08-05, Intel Research, 2008.
6. A. Chien, B. Calder, S. Elbert, and K. Bhatia. Entropia: Architecture and performance of an enterprise desktop grid system. Journal of Parallel and Distributed Computing, 63, 2003.
7. B.-G. Chun, F. Dabek, A. Haeberlen, E. Sit, H. Weatherspoon, M. F. Kaashoek, J. Kubiatowicz, and R. Morris. Efficient Replica Maintenance for Distributed Storage Systems. In NSDI'06: Proceedings of the 3rd conference on Networked Systems Design & Implementation, pages 4-4, Berkeley, CA, USA, 2006. USENIX Association.
8. J. Dean and S. Ghemawat. Mapreduce: simplified data processing on large clusters. Commun. ACM, 51(1), 2008.
9. G. Fedak, H. He, and F. Cappello. Bitdew: a programmable environment for large-scale data management and distribution. In SC '08: Proceedings of the 2008 ACM/IEEE conference on Supercomputing, pages 1-12, Piscataway, NJ, USA, 2008. IEEE Press.
10. A. Gharaibeh and M. Ripeanu. Exploring Data Reliability Tradeoffs in Replicated Storage Systems. In HPDC '09: Proceedings of the 18th ACM international symposium on High performance distributed computing, pages 217-226, New York, NY, USA, 2009. ACM.
11. S. Ghemawat, H. Gobioff, and S. Leung. The Google file system. In Proceedings of the 19th Symposium on Operating Systems Principles, 2003.
12. M. Grant, S. Sehrish, J. Bent, and J. Wang. Introducing map-reduce to high end computing. 3rd Petascale Data Storage Workshop, Nov 2008.
13. GridGain Systems, LLC. Gridgain. http://www.gridgain.com/.
14. A. Gupta, B. Lin, and P. A. Dinda. Measuring and understanding user comfort with resource borrowing. In HPDC '04: Proceedings of the 13th IEEE International Symposium on High Performance Distributed Computing, pages 214-224, Washington, DC, USA, 2004. IEEE Computer Society.
15. A. Haeberlen, A. Mislove, and P. Druschel. Glacier: Highly durable, decentralized storage despite massive correlated failures. In Proceedings of the 2nd Symposium on Networked Systems Design and Implementation (NSDI'05), May 2005.
16. B. Javadi, D. Kondo, J.-M. Vincent, and D. P. Anderson. Mining for Statistical Models of Availability in Large-Scale Distributed Systems: An Empirical Study of SETI@home. In 17th IEEE/ACM International Symposium on Modelling, Analysis and Simulation of Computer and Telecommunication Systems (MASCOTS), September 2009.
17. S. Ko, I. Hoque, B. Cho, and I. Gupta. On Availability of Intermediate Data in Cloud Computations. In 12th Workshop on Hot Topics in Operating Systems (HotOS XII), 2009.
18. D. Kondo, M. Taufe, C. Brooks, H. Casanova, and A. Chien. Characterizing and evaluating desktop grids: an empirical study. In Proceedings of the 18th International Parallel and Distributed Processing Symposium, 2004.
19. A. Matsunaga, M. Tsugawa, and J. Fortes. Cloudblast: Combining mapreduce and virtualization on distributed resources for bioinformatics. Microsoft eScience Workshop, 2008.
20. J. Strickland, V. Freeh, X. Ma, and S. Vazhkudai. Governor: Autonomic throttling for aggressive idle resource scavenging. In Proceedings of the 2nd IEEE International Conference on Autonomic Computing, 2005.
21. Sun Microsystems. Compute server. https://computeserver.dev.java.net/.
22. D. Thain, T. Tannenbaum, and M. Livny. Distributed Computing in Practice: The Condor Experience. Concurrency and Computation: Practice and Experience, 2004.
23. S. Vazhkudai, X. Ma, V. Freeh, J. Strickland, N. Tammineedi, and S. Scott. Freeloader: Scavenging desktop storage resources for bulk, transient data. In Proceedings of Supercomputing, 2005.
24. M. Zaharia, A. Konwinski, A. Joseph, R. Katz, and I. Stoica. Improving mapreduce performance in heterogeneous environments. In OSDI, 2008.
25. M. Zhong, K. Shen, and J. Seiferas. Replication degree customization for high availability. SIGOPS Oper. Syst. Rev., 42(4), 2008.