Orchestrating the deployment of computations in the cloud with conductor

Proceedings of NSDI 2012: 9th USENIX Symposium on Networked Systems Design and Implementation

Volumn , Issue , 2012, Pages 367-381

  Wieder, Alexander ^a   Bhatotia, Pramod ^a   Post, Ansley ^a,b   Rodrigues, Rodrigo ^a,c  

^a MAX PLANCK INSTITUTE FOR SOFTWARE SYSTEMS   (Germany)

^b GOOGLE INC   (United States)

^c UNIVERSIDADE NOVA DE LISBOA   (Portugal)

Author keywords

[No Author keywords available]

Indexed keywords

DISTRIBUTED DATABASE SYSTEMS; SYSTEMS ANALYSIS; WEB SERVICES;

CLOUD SERVICES; COMPLETION TIME; DEPLOYMENT TIME; DIFFERENT SERVICES; HADOOP FRAMEWORKS; LEVEL DIFFERENCE; PRICE FLUCTUATION; RESOURCE ABSTRACTION;

ABSTRACTING;

EID: 85072781406     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (20)

1. CHOHAN, N., CASTILLO, C., SPREITZER, M., STEINDER, M., TANTAWI, A., AND KRINTZ, C. See Spot Run: Using spot instances for MapReduce workflows. In 2nd USENIX Workshop on Hot Topics in Cloud Computing (2010).
2. DEAN, J., AND GHEMAWAT, S. Mapreduce: simplified data processing on large clusters. In OSDI'04: Proceedings of the 6th conference on Symposium on Opearting Systems Design & Implementation (Berkeley, CA, USA, 2004), USENIX Association.
3. DUSSEAU, A. C., ARPACI, R. H., AND CULLER, D. E. Effective distributed scheduling of parallel workloads. In SIGMET-RICS '96: Proceedings of the 1996 ACM SIGMETRICS international conference on Measurement and modeling ofcomputer systems (1996).
4. GANAPATHI, A. S. Predicting and Optimizing System Utilization and Performance via Statistical Machine Learning. PhD thesis, EECS Department, University of California, Berkeley, 2009.
5. HAJJAT, M., SUN, X., SUNG, Y.-W. E., MALTZ, D., RAO, S., SRIPANIDKULCHAI, K., AND TAWARMALANI, M. Cloudward bound: planning for beneficial migration of enterprise applications to the cloud. In Proceedings of the ACM SIGCOMM 2010 conference on SIGCOMM (New York, NY, USA, 2010), SIGCOMM'10, ACM.
6. HINDMAN, B., KONWINSKI, A., ZAHARIA, M., GHODSI, A., JOSEPH, A. D., KATZ, R., SHENKER, S., AND STOICA, I. Mesos: a platform for fine-grained resource sharing in the data center. In Proceedings of the 8th USENIX conference on Networked systems design and implementation (Berkeley, CA, USA, 2011), NSDI'11, USENIX Association.
7. ISARD, M., PRABHAKARAN, V., CURREY, J., WIEDER, U., TALWAR, K., AND GOLDBERG, A. Quincy: fair scheduling for distributed computing clusters. In SOSP '09: Proceedings of the ACM SIGOPS 22nd symposium on Operating systems principles (2009).
8. KEETON, K., KELLY, T., MERCHANT, A., SANTOS, C., WIENER, J., ZHU, X., AND BEYER, D. Don't settle for less than the best: Use optimization to make decisions. In HOTOS'07: Proceedings of the 11th USENIX workshop on Hot topics in operating systems (2007).
9. KO, S.Y., HOQUE, I., CHO, B., AND GUPTA, I. Making cloud intermediate data fault-tolerant. In Proceedings of the 1st ACM symposium on Cloud computing (New York, NY, USA, 2010), SoCC'10, ACM.
10. KRAWCZYK, S., AND BUBENDORFER, K. Grid resource allocation: allocation mechanisms and utilisation patterns. In Aus-Grid '08: Proceedings of the sixth Australasian workshop on Grid computing and e-research (Darlinghurst, Australia, Australia, 2008), Australian Computer Society, Inc.
11. LIU, H. Cutting mapreduce cost with spot market. In 3rd USENIX Workshop on Hot Topics in Cloud Computing (2011).
12. MUTHITACHAROEN, A., MORRIS, R., GIL, T.M., AND CHEN, B. Ivy: a read/write peer-to-peer file system. SIGOPS Operating Systems Review 36, SI (2002).
13. OLSTON, C., REED, B., SRIVASTAVA, U., KUMAR, R., AND TOMKINS, A. Pig latin: a not-so-foreign language for data processing. In SIGMOD '08: Proceedings of the 2008 ACM SIG-MOD international conference on Management ofdata (2008).
14. QURESHI, A., WEBER, R., BALAKRISHNAN, H., GUTTAG, J., AND MAGGS, B. Cutting the electric bill for internet-scale systems. In SIGCOMM '09: Proceedings of the ACM SIGCOMM 2009 conference on Data communication (2009).
15. RAMAN, R., LIVNY, M., AND SOLOMON, M. Matchmaking: Distributed resource management for high throughput computing. In HPDC '98: Proceedings of the 7th IEEE International Symposium on High Performance Distributed Computing (Washington, DC, USA, 1998), IEEE Computer Society, p. 140.
16. WIEDER, A., BHATOTIA, P., POST, A., AND RODRIGUES, R. Conductor: orchestrating the clouds. In Proceedings of the 4th International Workshop on Large Scale Distributed Systems and Middleware (LADIS 2010).
17. WIEDER, A., BHATOTIA, P., POST, A., AND RODRIGUES, R. Brief Announcement: Modelling MapReduce for Optimal Execution in the Cloud. In PODC'10: Proceedings of the 29th ACM symposium on Principles ofdistributed computing (2010).
18. YIN, Q., SCHUPBACH, A., CAPPOS, J., BAUMANN, A., AND ROSCOE, T. Rhizoma: a runtime for self-deploying, self-managing overlays. In Middleware '09: Proceedings of the 10th ACM/IFIP/USENIX International Conference on Middleware (2009).
19. ZAHARIA, M., BORTHAKUR, D., SEN SARMA, J., ELMELE-EGY, K., SHENKER, S., AND STOICA, I. Delay scheduling: a simple technique for achieving locality and fairness in cluster scheduling. In Proceedings of the 5th European conference on Computer systems (New York, NY, USA, 2010), EuroSys'10, ACM.
20. ZAHARIA, M., KONWINSKI, A., JOSEPH, A. D., KATZ, R., AND STOICA, I. Improving mapreduce performance in heterogeneous environments. In Proceedings of the 8th USENIX conference on Operating systemsdesign andimplementation (Berkeley, CA, USA, 2008), OSDI'08, USENIX Association.