The quantcast file system

Proceedings of the VLDB Endowment

Volumn 6, Issue 11, 2013, Pages 1092-1101

  Ovsiannikov, Michael ^a   Rus, Silvius ^a   Reeves, Damian ^b   Sutter, Paul ^a   Rao, Sriram ^c   Kelly, Jim ^a  

^a Quantcast   (United States)

^b GOOGLE INC   (United States)

^c MICROSOFT   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

C++ (PROGRAMMING LANGUAGE);

COMMAND LINE; DEVICE MANAGEMENT; EFFICIENCY IMPROVEMENT; ERASURE CODING; GLOBAL FEEDBACK; HADOOP DISTRIBUTED FILE SYSTEM (HDFS); HADOOP MAPREDUCE; WRITE THROUGHPUTS;

FILE ORGANIZATION;

EID: 84891127478     PISSN: None     EISSN: 21508097     Source Type: Journal    
DOI: 10.14778/2536222.2536234     Document Type: Article

References (13)

1. GPFS. http://en.wikipedia.org/wiki/GPFS.
2. QFS Repository. http://quantcast.github.com/qfs.
3. XFS. http://en.wikipedia.org/wiki/XFS.
4. J. Dean and S. Ghemawat.Mapreduce: Simplified data processing on large clusters. In OSDI, pages 137-150. USENIX Association, 2004.
5. H. Kuang.et al. HDFS RAID. http://wiki.apache.org/hadoop/HDFS-RAID, 2010.
6. A. Fikes. Storage architecture and challenges (google). http://tinyurl.com/6vbhgzn.
7. S. Ghemawat, H. Gobioff, and S.-T. Leung. The google file system. In M. L. Scott and L. L. Peterson, editors, SOSP, pages 29-43. ACM, 2003.
8. E. B. Nightingale, J. Elson, J. Fan, O. Hofmann, J. Howell, and Y. Suzue. Flat datacenter storage. In Proceedings of the 10th USENIX conference on Operating Systems Design and Implementation, OSDI'12, pages 1-15, Berkeley, CA, USA, 2012. USENIX Association.
9. M. Peterson. Using hadoop to expand data warehousing (neustar). http://tinyurl.com/cpjc7ko, 2013.
10. S. Rao et al. The kosmos file system. https://code.google.com/p/kosmosfs, 2010.
11. S. Rao, R. Ramakrishnan, A. Silberstein, M. Ovsiannikov, and D. Reeves. Sailfish: A framework for large scale data processing. In ACM Symposium on Cloud Computing, 2012.
12. S. Rus, M. Ovsiannikov, and J. Kelly. Quantsort: Revolution in map-reduce performance and operation. http://tinyurl.com/c4hkftm, 2011.
13. K. Shvachko, H. Kuang, S. Radia, and R. Chansler. The hadoop distributed file system. In M. G. Khatib, X. He, and M. Factor, editors, MSST, pages 1-10. IEEE Computer Society, 2010.