Ephemeral materialization points in stratosphere data management on the cloud

Advances in Parallel Computing

Volumn 23, Issue , 2013, Pages 163-181

  Höger, Mareike ^a   Kao, Odej ^a   Richter, Philipp ^a   Warneke, Daniel ^a  

^a TECHNISCHE UNIVERSITÄT BERLIN   (Germany)

Author keywords

Cloud Computing; Fault tolerance; Map Reduce

Indexed keywords

EID: 84895198393     PISSN: 09275452     EISSN: None     Source Type: Book Series    
DOI: 10.3233/978-1-61499-322-3-163     Document Type: Article

References (23)

1. D. Battŕe, S. Ewen, F. Hueske, O. Kao, V. Markl, and D. Warneke. Nephele/pacts: a programming model and execution framework for web-scale analytical processing. In Proceedings of the 1st ACM symposium on Cloud computing, SoCC '10, pages 119-130, New York, NY, USA, 2010. ACM.
2. B. K. Bhargava and S.-R. Lian. Independent checkpointing and concurrent rollback for recovery in distributed systems-an optimistic approach. In Symposium on Reliable Distributed Systems, pages 3-12, 1988.
3. V. Borkar, M. Carey, R. Grover, N. Onose, and R. Vernica. Hyracks: A flexible and extensible foundation for data-intensive computing. In Proceedings of the 2011 IEEE 27th International Conference on Data Engineering, ICDE '11, pages 1151-1162, Washington, DC, USA, 2011. IEEE Computer Society.
4. R. Chaiken, B. Jenkins, P.-A. Larson, B. Ramsey, D. Shakib, S. Weaver, and J. Zhou. Scope: easy and efficient parallel processing of massive data sets. Proc. VLDB Endow., 1:1265-1276, August 2008.
5. J. Cohen. Graph twiddling in a mapreduce world. Computing in Science Engineering, 11(4):29-41, july-aug. 2009.
6. T. Condie, N. Conway, P. Alvaro, J. M. Hellerstein, J. Gerth, J. Talbot, K. Elmeleegy, and R. Sears. Online aggregation and continuous query support in mapreduce. In Proceedings of the 2010 international conference on Management of data, SIGMOD '10, pages 1115-1118, New York, NY, USA, 2010. ACM.
7. J. Dean. Experiences with mapreduce, an abstraction for large-scale computation. Keynote I: PACT, 2006.
8. J. Dean and S. Ghemawat. Mapreduce: simplified data processing on large clusters. Commun. ACM, 51(1):107-113, 2008.
9. E. N. M. Elnozahy, L. Alvisi, Y.-M. Wang, and D. B. Johnson. A survey of rollbackrecovery protocols in message-passing systems. ACM Comput. Surv., 34(3):375-408, 2002.
10. A. Ghazal, R. Bhashyam, and A. Crolotte. Block optimization in the teradata rdbms. In Database and Expert Systems Applications, volume 2736 of Lecture Notes in Computer Science, pages 782-791. Springer Berlin/Heidelberg, 2003.
11. S. Ghemawat, H. Gobioff, and S.-T. Leung. The google file system. SIGOPS Oper. Syst. Rev., 37:29-43, Oct. 2003.
12. M. Isard, M. Budiu, Y. Yu, A. Birrell, and D. Fetterly. Dryad: distributed data-parallel programs from sequential building blocks. In EuroSys '07: Proceedings of the 2nd ACM SIGOPS/EuroSys European Conference on Computer Systems 2007, pages 59-72, New York, NY, USA, 2007. ACM.
13. D. B. Johnson. Efficient transparent optimistic rollback recovery for distributed application programs. Technical report, Pittsburgh, PA, USA, 1993.
14. H. Karloff, S. Suri, and S. Vassilvitskii. A model of computation for mapreduce. In Proceedings of the Twenty-First Annual ACM-SIAM Symposium on Discrete Algorithms, SODA '10, pages 938-948, Philadelphia, PA, USA, 2010. Society for Industrial and Applied Mathematics.
15. S. Kavulya, J. Tan, R. Gandhi, and P. Narasimhan. An analysis of traces from a production mapreduce cluster. In Proceedings of the 2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing, CCGRID '10, pages 94-103, Washington, DC, USA, 2010. IEEE Computer Society.
16. S. Y. Ko, I. Hoque, B. Cho, and I. Gupta. Making cloud intermediate data fault-tolerant. In Proceedings of the 1st ACM symposium on Cloud computing, SoCC '10, pages 181-192, New York, NY, USA, 2010. ACM.
17. Y. Kwon, M. Balazinska, and A. Greenberg. Fault-tolerant stream processing using a distributed, replicated file system. Proc. VLDB Endow., 1:574-585, August 2008.
18. J.-A. Quiane-Ruiz, C. Pinkel, J. Schad, and J. Dittrich. Rafting mapreduce: Fast recovery on the raft. In Data Engineering (ICDE), 2011 IEEE 27th International Conference on, pages 589-600, april 2011.
19. F. B. Schneider. Implementing fault-tolerant services using the state machine approach: a tutorial. ACM Comput. Surv., 22:299-319, December 1990.
20. P. Upadhyaya, Y. Kwon, and M. Balazinska. A latency and fault-tolerance optimizer for online parallel query plans. In Proceedings of the 2011 international conference on Management of data, SIGMOD '11, pages 241-252, New York, NY, USA, 2011. ACM.
21. Y.-M. Wang, P.-Y. Chung, I.-J. Lin, and W. K. Fuchs. Checkpoint space reclamation for uncoordinated checkpointing in message-passing systems. IEEE Trans. Parallel Distrib. Syst., 6(5):546-554, 1995.
22. D. Warneke and O. Kao. Nephele: efficient parallel data processing in the cloud. In MTAGS '09: Proceedings of the 2nd Workshop on Many-Task Computing on Grids and Supercomputers, pages 1-10, New York, NY, USA, 2009. ACM.
23. C. Yang, C. Yen, C. Tan, and S. Madden. Osprey: Implementing mapreduce-style fault tolerance in a shared-nothing distributed database. In Data Engineering (ICDE), 2010 IEEE 26th International Conference on, pages 657-668, march 2010.