Free factories: Unified infrastructure for data intensive web services

Proceedings of the 2008 USENIX Annual Technical Conference, USENIX 2008

Volumn , Issue , 2008, Pages 391-404

  Zaranek, Alexander Wait ^a   Clegg, Tom ^a   Vandewege, Ward ^a   Church, George M ^a  

^a HARVARD UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BATCH DATA PROCESSING; RANDOM ACCESS STORAGE; SCHEDULING ALGORITHMS; WEBSITES;

APPLICATION DEVELOPERS; COMMODITY HARDWARE; DATA INTENSIVE; MAPREDUCE MODELS; MULTIPLE CLUSTERS; REMOTE DATA CENTERS; SMALL CLUSTERS; STORAGE SERVICES;

WEB SERVICES;

EID: 69949184327     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (31)

1. Amazon.com, Inc. http://aws.amazon.com/.
2. Lakshmi N. Bairavasundaram, Garth R. Goodson, Shankar Pasupathy, and Jiri Schindler. An analysis of latent sector errors in disk drives. In SIGMETRICS’07, pages 289–300. ACM Press, 2007.
3. G. Bell, J. Gray, and A. Szalay. Petascale computational systems. IEEE Computer, 39(1):110–112, 2006.
4. John Brunelle, Peter Hurst, John Huth, Laura Kang, Chaki Ng, David C. Parkes, Margo Seltzer, Jim Shank, and Saul Youssef. Egg: An extensible and economics-inspired open grid computing platform. In GECON’06, Singapore, 2006. World Scientific Publishing.
5. Canonical Ltd. http://ubuntu.com.
6. Fay Chang, Jeffrey Dean, Sanjay Ghemawat, Wilson C. Hsieh, Deborah A. Wallach, Mike Burrows, Tushar Chandra, Andrew Fikes, and Robert E. Gruber. Bigtable: a distributed storage system for structured data. In OSDI’06, pages 205–218, Seattle, WA, 2006. USENIX Association.
7. G. M. Church. The personal genome project. Molecular Systems Biology, 1:2005.0030, 2005. http://personalgenomes.org.
8. Coreboot. http://coreboot.org.
9. Danga Interactive. http://danga.com.
10. R.K. Dash, N.R. Jennings, and D.C. Parkes. Computational-mechanism design: a call to arms. Intelligent Systems, 18(6):40–47, 2003.
11. Jeffrey Dean and Sanjay Ghemawat. MapReduce: Simplified data processing on large clusters. In OSDI’04, pages 137–150, San Francisco, CA, 2004. USENIX Association.
12. Jon G. Elerath and Michael Pecht. Enhanced reliability modeling of RAID storage systems. In DSN’07, pages 175–184, 25-28 June 2007.
13. Sanjay Ghemawat, Howard Gobioff, and Shun-Tak Leung. The Google file system. In SOSP’03, pages 29–43, New York, NY, 2003. ACM Press.
14. GNU Project. http://gnu.org.
15. Jim Gray, David T. Liu, Maria Nieto-Santisteban, Alex Szalay, David J. DeWitt, and Gerd Heber. Scientific data management in the coming decade. SIGMOD Record, 34:34–41, 2005.
16. Harvard University. Free Factories source code, 2008. http://factories.freelogy.org.
17. Jae Bum Kim, Gregory J Porreca, Lei Song, Steven C Greenway, Joshua M Gorham, George M Church, Christine E Seidman, and J. G. Seidman. Polony multiplex analysis of gene expression (PMAGE) in mouse hypertrophic cardiomyopathy. Science, 316(5830):1481–1484, Jun 2007.
18. Lawrence Livermore National Laboratory. https://computing.llnl.gov/linux/slurm/.
19. Jeantine E Lunshof, Ruth Chadwick, Daniel B Vorhaus, and George M Church. From genetic privacy to open consent. Nature Reviews Genetics, 9:406–411, May 2008.
20. Nature Publishing Group. Positively disruptive. Nature Genetics, 40(2):119, Feb 2008.
21. Opengear, Inc. http://opengear.com.
22. OpenVPN, Inc. http://openvpn.net.
23. Eduardo Pinheiro, Wolf-Dietrich Weber, and Luiz Andre Barroso. Failure trends in a large disk drive population. In FAST’07, San Jose, CA, 2007. USENIX Association.
24. Bianca Schroeder and Garth A. Gibson. Disk failures in the real world: What does an MTTF of 1,000,000 hours mean to you? In FAST’07. USENIX Association, 2007.
25. Jay Shendure, Gregory J Porreca, Nikos B Reppas, Xiaoxia Lin, John P McCutcheon, Abraham M Rosenbaum, Michael D Wang, Kun Zhang, Robi D Mitra, and George M Church. Accurate multiplex polony sequencing of an evolved bacterial genome. Science, 309(5741):1728–1732, Sep 2005.
26. Jeffrey Shneidman, Chaki Ng, David C. Parkes, Alvin AuYoung, Alex C. Snoeren, Amin Vahdat, and Brent Chun. Why markets could (but don’t currently) solve resource allocation problems in systems. In HotOS-X, Santa Fe, NM, 2005.
27. Software in the Public Interest. http://debian.org.
28. Alexander Szalay and Jim Gray. 2020 computing: science in an exponential world. Nature, 440(7083):413–414, Mar 2006.
29. X-Prize Foundation. Archon x-prize for genomics. http://genomics.xprize.org/.
30. Kun Zhang, Adam C Martiny, Nikos B Reppas, Kerrie W Barry, Joel Malek, Sallie W Chisholm, and George M Church. Sequencing genomes from single cells by polymerase cloning. Nature Biotechnology, 24(6):680–686, Jun 2006.
31. Kun Zhang, Jun Zhu, Jay Shendure, Gregory J Porreca, John D Aach, Robi D Mitra, and George M Church. Long-range polony haplotyping of individual human chromosome molecules. Nature Genetics, 38(3):382–387, Mar 2006.