The only constant is change: Incorporating time-varying network reservations in data centers

Computer Communication Review

Volumn 42, Issue 4, 2012, Pages 199-210

  Xie, Di ^a   Ding, Ning ^a   Hu, Y Charlie ^a   Kompella, Ramana ^a  

^a PURDUE UNIVERSITY   (United States)

Author keywords

Allocation; Bandwidth; Datacenter; Network reservation; Profiling

Indexed keywords

EID: 84894520398     PISSN: 01464833     EISSN: 19435819     Source Type: Conference Proceeding    
DOI: 10.1145/2377677.2377718     Document Type: Conference Paper

References (36)

1. Amazon ec2 api ec2-run-instances. http://doc5.amazonwebserviccs.com/ AWSEC2/latest/CommandLineReference/ApiRefcrence-cmd-Runlnstanccs.html.
2. Apache hive, http://hive.apache.org/.
3. Apache pig. http://pig.apache.org/.
4. Cisco nexus 7000. http://wwwcisco.com/en/US/prod/collateral/switches/ ps944l/ps9402/ps95l2/Data-Sheet-C78-437757.pdf.
5. Hive performance benchmarks, https.//issues.apache.org/jira/browse/HIVE- 396.
6. S. Agarwal, S. Kandula, N. Bruno, M.-C. Wu, I. Stoica, and J. Zhou. Re-Optimizing data-parallel computing. In Proc. of USENIX NSDI, 2012.
7. M. Al-Fares, A. Loukissas, and A. Vahdal. A scalable, commodity data center network architecture. In Proc. of ACM SIGCOMM. 2008.
8. M. Al-fares, S Radhakrishnan, et al. Hedera: Dynamic flow scheduling for data center networks. In Proc. of USENIX NSDI. 2010.
9. G. Ananthanarayanan, S Kandula, A. Cireenbcrg, I. Stoica, Y. Lu, B. Saha, and E. Harris. Reining in the outliers in map-reduce clusters using mantri. In Pmc. of USENIX OSDI. 2010.
10. H Ballam, P Costa, T. Karagianms, and A. Rowstron. The price is right: Towards location-independent costs in datacenters In Pmc. of ACM HotNets, 2011.
11. H. Ballam, P Costa, T. Karagianms, and A. I. T. Rowstron. Towards predictable datacenter networks. In Proc. of ACMSIGCOMM. 2011.
12. F. Rancilhon and R. Ramaknshnan. An amateur's introduction to recursiv query roccssing strategies In In Pmc. of SIGMOD. 1986.
13. C. Brcnton. Hypervisor vs host based security. https:// cloudsecurityallianccorg/wp-content/uploads/2011/11/hypervisor-vs-hostbased- sccunty.pdf.
14. Y. Bu, B Howe, M Balaztnska, and M D. Ernst. HaLoop: Efficient Iterative Data Proecssing on 1-arge Clusters. Proc of the VLDB Endowment. 3( 1), 2010.
15. N Chowdhury et al Virtual Network Embedding with Coordinated Node and Link Mapping In IEEE INFOCOM. 2009.
16. T. Condie, N Conway, P. Alvaro, J M. Hellerstein, J. Gerth, J. Talbot, K Elmclecgy, and R. Sears. Online aggregation and continuous query support in maprcducc In ACM SIGMOD. 2010.
17. J. Dean and S Ghemawat MapReduce: Simplified Data Processing on Large Clusters In Proc. of USENIX OSDI. December 2004.
18. N. G Dufticld, P. Goyal, A Greenherg, et al. A flexible model for resource management in virtual private networks In Proc. of ACM SIGCOMM, 1999.
19. A. Greenberg, J. R Hamilton, el al. VL2: A scalable and flexible data center network. In Proc. of ACM SIGCOMM. 2009.
20. C Guo, G Lu, H J Wang, S. Yang, C Kong, et al Secondnet: A data center network virilization architecture with bandwidth guarantees. In Proc. of ACM CoNEXT. 2010.
21. H. Herodotou and S. Babu, Profiling, what-if analysis, and cost-based optimization of mapreduce programs. PVLDB. 4( 11): 1111-1122, 2011.
22. H. Herodotou, F Dong, and S Babu No one (cluster) size fits all: Automatic cluster sizing for data-intensive analytics In Pmc. of ACM SOCC. Oct. 2011.
23. H. Herodotou, H. Lim, G. Luo, N. Borisov, L. Dong, F. B. Cetin, and S. Babu Starfish: A self-tuning system for big data analytics. In Pmc. of CIDK. 2011.
24. B. Hindman, A Konwinski, M. Zaharia, A. Ghodsi, A. D Joseph, R Katz, S. Shenker, and I. Stoica. Mesos: A platform for fine-grained resource sharing in the data center. In Proc. of USENIX NSDI. 2011.
25. J. Kleinberg. Authoritative sources in a hyperlinked environment. J. ACM. 46(5), 1999.
26. T. Lam and G. Varghesc Netsharc: Virtualizing bandwidth within the cloud. UCSD Technical Report. 2009.
27. J. Mudigonda, P Yalagandula, M Al-Fares, and H L. Jeffrey Mogul. SPAIN: COTS data-center ethernet for multipathing over arbitrary topologies. In Proc of USENIX NSDI. 2010.
28. D. G. Murray, M Schwarzkopf, C. Smowton, S. Smith, A. Madhavapcddy, and S. Hand. Ciel: A universal execution engine for distributed data-flow computing. In Proc. of USENIX NSDI. 2011.
29. L. Page, S. Brin, R Motwam, and T. Winograd The PageRank citation ranking: Bringing order to the Web. Technical Report 1999-66), Stanford Infolah. 1999.
30. L. Popa, A. Krishnamurthy, S. Ratnasamy, and I. Stoica. Faircloud: Sharing the network in cloud computing. In ACM HotNets. 2011.
31. C. Raiciu, S. Barrc, C Pluntkc, A. Greenhalgh, D. Wischik, and M Handley. Improving datacenter performance and robustness with multipath tcp. In Proc. of ACM SIGCOMM. 2011.
32. R. Ricci, C. Alfeld, and J. Lepreau. A Solver for the Network Testbed Mapping Problem. SIGCOMM CCR. 33(2). 2003.
33. H. Rodrigues et al. Gatekeeper: Supporting bandwidth guarantees for multi-tenant datacenter networks. HP Technical Report. 2011.
34. A. Shieh, S. Kandula, A Greenberg, C. Kim, and B Saha. Sharing the data center network In Proc. of USENIX NSDI. 2011.
35. M. Yu, Y. Yi, J. Rexford, and M. Chiang. Rethinking virtual network embedding: substrate support for path splitting and migration. ACM SIGCOMM CCR. 38(2). 2008.
36. M. Zaharia, D. Borthakur, J. Sen Sarma, K. Elmclecgy, S. Shenker and I Stoica. Delay scheduling: A simple technique for achieving locality and fairness in cluster scheduling In Proc. of EuroSys, 2010.