Why let resources idle? Aggressive cloning of jobs with Dolly

4th USENIX Workshop on Hot Topics in Cloud Computing, HotCloud 2012

Volumn , Issue , 2012, Pages

  Ananthanarayanan, Ganesh ^a   Ghodsi, Ali ^a   Shenker, Scott ^a   Stoica, Ion ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CLONE CELLS; CLONING; CLOUD COMPUTING;

COMPLETION TIME; FACEBOOK; HEAVY-TAILS; JOB SIZE; MITIGATION STRATEGY; TRACE DRIVEN SIMULATION;

STATISTICS;

EID: 85088777566     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (18)

1. J. Dean and S. Ghemawat. Mapreduce: Simplified data processing on large clusters. In USENIX OSDI, 2004.
2. M. Zaharia, A. Konwinski, A. D. Joseph, R. Katz, I. Stoica. Improving MapReduce Performance in Heterogeneous Environments. In USENIX OSDI, 2008.
3. G. Ananthanarayanan, S. Kandula, A. Greenberg, I. Stoica, E. Harris, and B. Saha. Reining in the Outliers in Map-Reduce Clusters using Mantri. In USENIX OSDI, 2010.
4. C. Wilson, H. Ballani, T. Karagiannis, A. Rowstron. Better Never than Late: Meeting Deadlines in Datacenter Networks. In SIG-COMM, 2011.
5. S. Melnik, A. Gubarev, J. J. Long, G. Romer, S. Shivakumar, M. Tolton, T. Vassilakis. Dremel: Interactive Analysis of Web-Scale Datasets. In VLDB, 2010.
6. D. Meisner, C. M. Sadler, L. A. Barroso, W-D Weber, and T F. Wenisch. Power management of online data-intensive services. In ISCA, 2011.
7. S. Govindan, A. Sivasubramaniam, B. Urgaonkar. Benets and Limitations of Tapping into Stored Energy For Datacenters. In ISCA, 2011.
8. Hadoop. http://hadoop.apache.org.
9. L. A. Barroso. Warehouse-scale computing: Entering the teenage decade. In ISCA, 2011.
10. Y. Chen, S. Alspaugh, D. Borthakur, R. Katz. Energy Efficiency for Large-Scale MapReduce Workloads with Significant Interactive Analysis. In ACM EuroSys, 2012.
11. L. Ganesh, J. Liu, S. Nath, G. Reeves, F. Zhao. Unleash stranded power in data centers with rackpacker. In WEED, 2009.
12. G. Ananthanarayanan, A. Ghodsi, A. Wang, D. Borthakur, S. Kandula, S. Shenker, I. Stoica. PACMan: Coordinated Memory Caching for Parallel Jobs. In USENIX NSDI, 2012.
13. M. Isard, V. Prabhakaran, J. Currey, U. Wieder, K. Talwar, and A. Goldberg. Quincy: Fair Scheduling for Distributed Computing Clusters. In ACM SOSP, 2009.
14. G. Ananthanarayanan, S. Agarwal, S. Kandula, A. Greenberg, I. Stoica, D. Harlan, E. Harris. Scarlett: Coping with Skewed Popularity Content in MapReduce Clusters. In EuroSys, 2011.
15. A. Krioukov, P. Mohan, S. Alspaugh, L. Keys, D. E. Culler and R. H. Katz. NapSAC: The design and implementation of a power proportional web cluster. In ACM GreenNets, 2010.
16. Y. Chen, L. Keys, R. Katz. Towards Energy Efficient Hadoop. In Hadoop Summit, 2009.
17. M. Zaharia, M. Chowdhury, T. Das, A. Dave, J. Ma, M. Mc-Cauley, M.J. Franklin, S. Shenker, and I. Stoica. Resilient Distributed Datasets: A Fault-Tolerant Abstraction for In-Memory Cluster Computing. In USENIX NSDI, 2012.
18. G. Ananthanarayanan, A. Ghodsi, S. Shenker, I. Stoica. Disk Locality Considered Irrelevant. In USENIX HotOS, 2011.