Disk-locality in datacenter computing considered irrelevant

13th Workshop on Hot Topics in Operating Systems, HotOS 2011

Volumn , Issue , 2011, Pages

  Ananthanarayanan, Ganesh ^a   Ghodsi, Ali ^a   Shenker, Scott ^a   Stoica, Ion ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84858620646     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (29)

1. 40 and 100 Gigabit Ethernet. http://www.extremenetworks.com.
2. An Updated Forecast of Worldwide Information Growth Through 2011. http://bit.ly/U1n6k.
3. Applications and Organizations using Hadoop. http://wiki.apache.org/hadoop/PoweredBy.
4. DETER. http://deter.cs.berkeley.edu/.
5. Flash on Compute Servers. http://www.hpts.ws/session1/kleiman.pdf. HPTPS, 2009.
6. Hadoop. http://hadoop.apache.org.
7. Implications of Storage Class Memories (SCM) on Software Architectures. http://www.hpts.ws/session2/mohan. pdf. HPTPS, 2009.
8. S. R. Hetzler. The Storage Chasm: Implications for the future of HDD and Solid State Storage. http://www.idema.org/.
9. Technologies for Data-Intensive Computing. http://www.hpts.ws/agenda.html. HPTPS, 2009.
10. The Global Memory System (GMS) Project. http://www.cs.washington.edu/homes/levy/gms/.
11. The NOW Project. http://now.cs.berkeley.edu/.
12. Dileep Bhandarkar on Datacenter Energy Efficiency, 2011. http://bit.ly/e3LVu8.
13. A. Thusoo, Z. Shao, S. Anthony, D. Borthakur, N. Jain, J. S. Sarma, R. Murthy, H. Liu. Data warehousing and analytics infrastructure at facebook. In ACM SIGMOD, 2010.
14. G. Ananthanarayanan, S. Kandula, A. Greenberg, I. Stoica, E. Harris, and B. Saha. Reining in the Outliers in Map-Reduce Clusters using Mantri. In USENIX OSDI, 2010.
15. B. Hindman, A. Konwinski, M. Zaharia, A. Ghodsi, A. Joseph, R. Katz, S. Shenker, I. Stoica. Mesos: A Platform for Fine-Grained Resource Sharing in the Data Center. In USENIX NSDI, 2011.
16. D. Narayanan, E. Thereska, A. Donnelly, S. Elnikety, A. Rowstron. Migrating Enterprise Storage to SSDs: Analysis of Tradeoffs. In ACM EuroSys, 2009.
17. J. Dean and S. Ghemawat. MapReduce: Simplified Data Processing on Large Clusters. In USENIX OSDI, 2004.
18. G. Ananthanarayanan, S. Agarwal, S. Kandula, A. Greenberg, I. Stoica, D. Harlan, E. Harris. Scarlett: Coping with Skewed Popularity Content in MapReduce Clusters. In ACM EuroSys, 2011.
19. G. Porter. Towards Decoupling Storage and Computation in Hadoop with SuperDataNodes. In ACM LADIS, 2009.
20. H. Garcia-Molina and K. Salem. Main Memory Database Systems: An Overview. In IEEE TKDE, 1992.
21. M. Isard, V. Prabhakaran, J. Currey, U. Wieder, K. Talwar, and A. Goldberg. Quincy: Fair Scheduling for Distributed Computing Clusters. In ACM SOSP, 2009.
22. J. Ousterhout et al. The Case for RAMClouds: Scalable High-Performance Storage Entirely in DRAM. In SIGOPS Operating Systems Review, 2009.
23. L. A. Barroso and U. Holzle. The Datacenter as a Computer. http://bit.ly/2IJd8j.
24. M. Al-Fares, A. Loukissas, and A. Vahdat. A Scalable, Commodity Data Center Network Architecture. In ACM SIGCOMM, 2008.
25. M. Isard, M. Budiu, Y. Yu, A. Birrell and D. Fetterly. Dryad: Distributed Data-parallel Programs from Sequential Building Blocks. In ACM Eurosys, 2007.
26. M. Zaharia, D. Borthakur, J. Sen Sarma, K. Elmeleegy, S. Shenker, I. Stoica. Delay Scheduling: A Simple Technique for Achieving Locality and Fairness in Cluster Scheduling. In ACM Eurosys, 2010.
27. M. Zaharia, M. Chowdhury, M. J. Franklin, S. Shenker, I. Stoica. Spark: Cluster Computing with Working Sets. In USENIX HotCloud, 2010.
28. Kirk McKusick and Sean Quinlan. GFS: Evolution on Fast-Forward. CACM, March 2010.
29. R. Power and J. Li. Piccolo: Building Fast, Distributed Programs with Partitioned Tables. In USENIX OSDI, 2010.