On availability of intermediate data in cloud computations

Proceedings of HotOS 2009 - 12th Workshop on Hot Topics in Operating Systems

Volumn , Issue , 2009, Pages

  Ko, Steven Y ^a   Hoque, Imranul ^a   Cho, Brian ^a   Gupta, Indranil ^a  

^a UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

FILE ORGANIZATION; MAMMALS;

DATA AVAILABILITY; DATA STORAGE SYSTEMS; DATA-FLOW COMPUTATION; DESIGN IDEAS; DISTRIBUTED FILE SYSTEMS; MAP-REDUCE; SALIENT FEATURES; TRANSPORT PROTOCOLS;

DIGITAL STORAGE;

EID: 84864276011     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (12)

1. Hadoop Presentations. http://wiki.apache.org/hadoop/HadoopPresentations.
2. Sorting 1PB with MapReduce. http://googleblog.blogspot.com/2008/11/sorting-1pb-with-mapreduce.html.
3. M. G. Baker, J. H. Hartman, M. D. Kupfer, K. W. Shirriff, and J. K. Ousterhout. Measurements of a Distributed File System. SIGOPS OSR, 25(5), 1991.
4. J. Dean. Experiences with MapReduce, an Abstraction for Large-Scale Computation. In Keynote I: PACT, 2006.
5. J. Dean and S. Ghemawat. MapReduce: Simplified Data Processing on Large Clusters. In Proc. of USENIX OSDI, 2004.
6. Dryad Project Page at MSR. http://research. microsoft.com/en-us/projects/Dryad/.
7. M. Isard, M. Budiu, Y. Yu, A. Birrell, and D. Fetterly. Dryad: Distributed Data-Parallel Programs From Sequential Building Blocks. In Proc. of ACM EuroSys, 2007.
8. C. Olston, B. Reed, U. Srivastava, R. Kumar, and A. Tomkins. Pig Latin: A Not-So-Foreign Language for Data Processing. In Proc. of ACM SIGMOD, 2008.
9. Powered by Hadoop. http://wiki.apache.org/hadoop/PoweredBy.
10. A. Venkataramani, R. Kokku, and M. Dahlin. TCP Nice: A Mechanism for Background Transfers. In Proc. of USENIX OSDI, 2002.
11. W. Vogels. File System Usage in Windows NT 4.0. In Proc. of ACM SOSP, 1999.
12. M. Zaharia, A. Konwinski, A. D. Joseph, R. Katz, and I. Stoica. Improving MapReduce Performance in Heterogeneous Environments. In Proc. of USENIX OSDI, 2008.