Accelerating batch analytics with residual resources from interactive clouds

Proceedings - IEEE Computer Society's Annual International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunications Systems, MASCOTS

Volumn , Issue , 2013, Pages 414-423

  Clay, R Benjamin ^a   Shen, Zhiming ^a   Ma, Xiaosong ^a,b  

^a North Carolina State University   (United States)

^b OAK RIDGE NATIONAL LABORATORY   (United States)

Author keywords

Adaptive systems; Distributed computing; Performance analysis

Indexed keywords

EID: 84894578522     PISSN: 15267539     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/MASCOTS.2013.63     Document Type: Conference Paper

References (25)

1. NCSU, "NCSU Virtual Computing Lab," vcl. ncsu. edu/.
2. J. Li, A. Deshpande, J. Srinivasan et al., "Energy and performance impact of aggressive volunteer computing with multi-core computers," in MASCOTS '09.
3. T. Wood, P. Shenoy, A. Venkataramani et al., "Black-box and gray-box strategies for virtual machine migration," in NSDI '07.
4. N. Chohan, C. Castillo, M. Spreitzer et al., "See spot run: using spot instances for mapreduce workflows," in HotCloud'10.
5. G. Lee, B.-G. Chun, and R. H. Katz, "Heterogeneity-aware resource allocation and scheduling in the cloud," in HotCloud'11.
6. H. Lin, X. Ma, J. Archuleta et al., "Moon: Mapreduce on opportunistic environments," in HPDC '10.
7. B. Lin and P. Dinda, "Vsched: Mixing batch and interactive virtual machines using periodic real-time scheduling," in SC '05.
8. A. D. Ferguson, P. Bodik, S. Kandula et al., "Jockey: Guaranteed job latency in data parallel clusters," in EuroSys'12.
9. H. Herodotou, F. Dong, and S. Babu, "No one (cluster) size fits all: Automatic cluster sizing for data-intensive analytics," in SOCC '11.
10. J. Polo, C. Castillo, D. Carrera et al., "Resource-aware adaptive scheduling for mapreduce clusters," in Middleware'11, 2011.
11. A. Wieder, P. Bhatotia, A. Post et al., "Orchestrating the deployment of computations in the cloud with conductor," in NSDI '12.
12. M. Litzkow, M. Livny, and M. Mutka, "Condor-a hunter of idle workstations," in DCS '88.
13. D. Anderson, "Boinc: A system for public-resource computing and storage," in Grid '04.
14. A. Gupta, B. Lin, and P. Dinda, "Measuring and understanding user comfort with resource borrowing," in HPDC '04.
15. A. Chandra and J. Weissman, "Nebulas: Using distributed voluntary resources to build clouds," in HotCloud'09.
16. L. Yu and D. Thain, "Resource management for elastic cloud workflows," in CCGrid '12.
17. S. Agarwal, S. Kandula, N. Bruno et al., "Re-optimizing data-parallel computing," in NSDI '12.
18. B. Hindman, A. Konwinski, M. Zaharia et al., "Mesos: a platform for fine-grained resource sharing in the data center," in NSDI'11.
19. H. Liu, "Cutting mapreduce cost with spot market," in HotCloud'11.
20. R. B. Clay, Z. Shen, and X. Ma, "Building and scaling virtual clusters with residual resources from interactive clouds," NCSU, Tech. Rep. TR-2013-4 (Department of Computer Science).
21. T. Deshane, Z. Shepherd, J. N. Matthews et al., "Quantitative comparison of xen and kvm," in Xen Summit '08.
22. Cisco, "Enterprise Virtual Desktop Infrastructure: Design for Performance and Reliability," http://cisco. com/en/US/solutions/collateral/ ns340/ ns517/ns224/ns377/white paper c11-541004 R2 v7. pdf.
23. M. Zaharia, A. Konwinski, A. D. Joseph et al., "Improving mapreduce performance in heterogeneous environments," in OSDI '08.
24. Y. Chen, S. Alspaugh, and R. H. Katz, "Design insights for mapreduce from diverse production workloads," UCB, Tech. Rep. EECS-2012-17.
25. X. Liu, L. Sha, Y. Diao et al., "Online response time optimization of apache web server," in IWQoS'03.