On the use of microservers in supporting hadoop applications

2014 IEEE International Conference on Cluster Computing, CLUSTER 2014

Volumn , Issue , 2014, Pages 66-74

  Anwar, Ali ^a   Krish, K R ^a   Butt, Ali R ^a  

^a VIRGINIA POLYTECHNIC INSTITUTE AND STATE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COSTS; ECONOMIC AND SOCIAL EFFECTS; ENERGY EFFICIENCY; ENERGY UTILIZATION; OPERATING COSTS; PROGRAM PROCESSORS;

ACQUISITION COSTS; CLUSTER SIMULATIONS; COMPUTING SUBSTRATES; HADOOP PLATFORMS; HARDWARE CONFIGURATIONS; ORDERS OF MAGNITUDE; QUANTITATIVE STUDY; TOTAL COST OF OWNERSHIP;

CLUSTER COMPUTING;

EID: 84917736135     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CLUSTER.2014.6968753     Document Type: Conference Paper

References (51)

1. How Clean is Your Cloud?, 2012. http: //www. greenpeace. org/international/en/publications /Campaignreports/ Climate-Reports/How-Clean-is-Your-Cloud/.
2. AMD. Amd unveils its first arm cpu, the 64-bit 8-core opteron a1100, 2014. http: //www. extremetech. com/computing/175583-Amd-unveils-itsfirst-Arm-based-cpu-The-64-bit-8-core-opteron-A1100.
3. D. G. Andersen, J. Franklin, M. Kaminsky, A. Phanishayee, L. Tan, and V. Vasudevan. Fawn: A fast array of wimpy nodes. In ACM SIGOPS 22nd, 2009.
4. D. G. Andersen and S. Swanson. Rethinking flash in the data center. IEEE micro, 2010.
5. Apache Software Foundation. Hadoop, 2011. http: //hadoop. apache. org/core/, accessed on Nov 6, 2013.
6. C. Barnum, D. Dayton, K. Gillis, and J. O'Connor. Making connectionsteaming up to connect users, developers, and usability experts. In IEEE IPCC, 2005.
7. D. Borthakur. Facebook has the world's largest hadoop cluster!, 2010. http: //hadoopblog. blogspot. com/2010/05/facebook-has-worldslargest-hadoop. html.
8. D. e. Borthakur. Apache hadoop goes realtime at Facebook. SIGMOD '11. ACM, 2011.
9. Y. Chen, S. Alspaugh, D. Borthakur, and R. Katz. Energy efficiency for large-scale mapreduce workloads with significant interactive analysis. In Proceedings of the 7th ACM european conference on Computer Systems, 2012.
10. Y. Chen, A. Ganapathi, R. Griffith, and R. Katz. The case for evaluating mapreduce performance using workload suites. In IEEE MASCOTS, 2011.
11. B.-G. Chun, G. Iannaccone, G. Iannaccone, R. Katz, G. Lee, and L. Niccolini. An energy case for hybrid datacenters. ACM SIGOPS, 2010.
12. E. S. Chung, J. D. Davis, and J. Lee. Linqits: Big data on little clients. In ACM ISCA, 2013.
13. S. J. Cox, J. T. Cox, R. P. Boardman, S. J. Johnston, M. Scott, and N. S. OBrien. Iridis-pi: a low-cost, compact demonstration cluster. Cluster Computing, pages 1-10, 2013.
14. F. Dong. Extending Starfish to Support the Growing Hadoop Ecosystem. PhD thesis, Duke University, 2012.
15. A. Dou, V. Kalogeraki, D. Gunopulos, T. Mielikainen, and V. H. Tuulos. Misco: a mapreduce framework for mobile systems. In ACM PETRA, 2010.
16. L. M. Ellram. Total cost of ownership. In Handbuch Industrielles Beschaffungsmanagement, pages 659-671. Springer, 2002.
17. R. Ge, X. Feng, S. Song, H.-C. Chang, D. Li, and K. W. Cameron. Powerpack: Energy profiling and analysis of high-performance systems and applications. IEEE TPDS, 21(5): 658-671, 2010.
18. Í. Goiri, K. Le, T. D. Nguyen, J. Guitart, J. Torres, and R. Bianchini. Greenhadoop: leveraging green energy in data-processing frameworks. In Eurosys, 2012.
19. B. Gu, D. Choi, and Y. Kwak. Potentiality for executing hadoop map tasks on gpgpu via jni. In Multimedia and Ubiquitous Engineering. Springer, 2013.
20. J. R. Hauser and J. Wawrzynek. Garp: A mips processor with a reconfigurable coprocessor. In IEEE FCCM, 1997.
21. G. Horvat, D. Vinko, and D. Zagar. Household power outlet overload protection and monitoring using cost effective embedded solution. In IEEE MECO, 2013.
22. S. Huang, J. Huang, Y. Liu, L. Yi, and J. Dai. Hibench: A representative and comprehensive hadoop benchmark suite. In Proceedings of the ICDE Workshops, volume 2010, 2010.
23. M. Isard, M. Budiu, Y. Yu, A. Birrell, and D. Fetterly. Dryad: distributed data-parallel programs from sequential building blocks. ACM SIGOPS, 2007.
24. D. Jaggar. ARM Architecture Reference Manual. Prentice Hall, 1996.
25. J.-P. Jamont, L. Médini, and M. Mrissa. Les objets communicants.
26. S. B. Joshi. Apache hadoop performance-tuning methodologies and best practices. In IEEE SIPEW, 2012.
27. Y. Jung, R. Neill, and L. P. Carloni. A broadband embedded computing system for mapreduce utilizing hadoop. In IEEE CloudCom, 2012.
28. R. T. Kaushik and M. Bhandarkar. Greenhdfs: towards an energyconserving, storage-efficient, hybrid hadoop compute cluster. In USENIX ATC, 2010.
29. L. Keys, S. Rivoire, and J. D. Davis. The search for energy-efficient building blocks for the data center. In Computer Architecture, pages 172-182. Springer, 2012.
30. K. Krish, A. Anwar, and A. R. Butt. hats: A heterogeneity-Aware tiered storage for hadoop. 2014.
31. K. Krish, A. Anwar, and A. R. Butt. sched: A heterogeneity-Aware hadoop workflow scheduler. 2014.
32. I. Manousakis and D. S. Nikolopoulos. Epc: a power instrumentation controller for embedded applications. SIGBED Review, 9(2): 28-32, 2012.
33. R. Mantri, R. Ingle, and P. Patil. Scdp: Scalable, cost-effective, distributed and parallel computing model for academics. In ICECT'2011.
34. E. E. Marinelli. Hyrax: cloud computing on mobile devices using mapreduce. Technical report, 2009.
35. C. May, E. Silha, R. Simpson, H. Warren, et al. The PowerPC Architecture: A specification for a new family of RISC processors. Morgan Kaufmann Publishers Inc., 1994.
36. M. G. Noll. Running hadoop on ubuntu linux (multi-node cluster). 2007. http: //www. michael-noll. com/tutorials/running-hadoop-onubuntu-linux-multi-nodecluster/.
37. N. Rajovic, A. Rico, N. Puzovic, C. Adeniyi-Jones, and A. Ramirez. Tibidabo: Making the case for an arm-based hpc system. Future Generation Computer Systems, 2013.
38. S. Rivoire, M. A. Shah, P. Ranganathan, and C. Kozyrakis. Joulesort: a balanced energy-efficiency benchmark. In ACM SIGMOD, 2007.
39. B. Smith. Arm and intel battle over the mobile chip's future. Computer, 2008.
40. Tronsmart. Mk908, 2013. www. geekbuying. com/item/Tronsmart-MK908-Google-Android-4-1-Mini-PC-TV-Box-RK3188-Quad-Core-2G-8G-BT-Black-315155. html.
41. F. P. Tso, D. R. White, S. Jouet, J. Singer, and D. P. Pezaros. The glasgow raspberry pi cloud: A scale model for cloud computing infrastructures. In IEEE ICDCSW, 2013.
42. J. Turley. Coldfire doubles performance with v4. Microprocessor Report, 26, 1998.
43. V. K. Vavilapalli, A. C. Murthy, C. Douglas, S. Agarwal, M. Konar, R. Evans, T. Graves, J. Lowe, H. Shah, S. Seth, B. Saha, C. Curino, O. O'Malley, S. Radia, B. Reed, and E. Baldeschwieler. Apache hadoop yarn: Yet another resource negotiator. In Proc. SOCC. ACM, 2013.
44. C. Wang, X. Li, X. Zhou, Y. Chen, and R. C. Cheung. Big data genome sequencing on zynq based clusters. In ACM SIGDA, 2014.
45. G. Wang, A. R. Butt, H. Monti, and K. Gupta. Towards synthesizing realistic workload traces for studying the hadoop ecosystem. In IEEE MASCOTS, 2011.
46. G. Wang, A. R. Butt, P. Pandey, and K. Gupta. A simulation approach to evaluating design decisions in mapreduce setups. In IEEE MASCOTS, 2009.
47. G. Wang, A. Khasymski, K. Krish, and A. R. Butt. Towards improving mapreduce task scheduling using online simulation based predictions. In IEEE MASCOTS, 2013.
48. T. White. Hadoop: The Definitive Guide: The Definitive Guide. O'Reilly Media, 2009.
49. Wnadboard. Sata boot, 2013. http: //www. wandboard. org/index. php/50-20131017-wandboard-sata-boot.
50. N. Yigitbasi, K. Datta, N. Jain, and T. Willke. Energy efficient scheduling of mapreduce workloads on heterogeneous clusters. In 2nd International Workshop on Green Computing Middleware (GCM), 2011.
51. N. Zhu, L. Rao, X. Liu, J. Liu, and H. Guan. Taming power peaks in mapreduce clusters. In ACM SIGCOMM Computer Communication Review, 2011.