Multiple bulk data transfers scheduling among datacenters

Computer Networks

Volumn 68, Issue , 2014, Pages 123-137

  Wang, Yiwen ^a   Su, Sen ^a   Liu, Alex X ^b   Zhang, Zhongbao ^a  

^a BEIJING UNIVERSITY OF POSTS AND TELECOMMUNICATIONS   (China)

^b Michigan State University   (United States)

Author keywords

Bulk data transfers scheduling; Inter datacenter traffic; Optimization models and methods; Traffic engineering

Indexed keywords

COST REDUCTION; DATA TRANSFER; ELECTRIC NETWORK TOPOLOGY; ITERATIVE METHODS; LINEAR PROGRAMMING; NETWORK ARCHITECTURE; OPTIMIZATION; PROBLEM SOLVING; TRAFFIC CONGESTION;

BULK DATA TRANSFER; COMPUTATIONAL COSTS; EXTENSIVE SIMULATIONS; LINEAR PROGRAMMING MODELS; OPTIMIZATION MODELS; OPTIMIZATION PROBLEMS; TIME-EXPANDED NETWORKS; TRAFFIC ENGINEERING;

SCHEDULING;

EID: 84902372338     PISSN: 13891286     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.comnet.2014.02.017     Document Type: Article

References (31)

1. James Hamilton's Blog, Inter-Datacenter Replication & Geo-Redundancy. < http://perspectives.mvdirona.com >.
2. Amazon CloudFront. < http://aws.amazon.com/cn/cloudfront/ >.
3. A. Qureshi, R. Weber, H. Balakrishnan, J. Guttag, and B. Maggs Cutting the electric bill for internet-scale systems ACM SIGCOMM Comput. Commun. Rev. 39 4 2009 123 134
4. P.X. Gao, A.R. Curtis, B. Wong, and S. Keshav It's not easy being green ACM SIGCOMM Comput. Commun. Rev. 42 4 2012 211 222
5. D. Ziegler, Distributed Peta-Scale Data Transfer. < http://www.cs.huji.ac.il/dhay/IND2011.html >.
6. Y. Chen, S. Jain, V.K. Adhikari, Z.L. Zhang, and K. Xu A first look at inter-data center traffic characteristics via Yahoo! datasets INFOCOM, 2011 Proceedings IEEE 2011 IEEE 1620 1628
7. Forrester Research: The Future of Data Center Wide-Area Networking. < http://info.infineta.com/1/5622/2011-01-27/ >.
8. IRG Report: Big Data, Big Traffic and the WAN. < http://www.infineta. com/solutions/big-data >.
9. N. Laoutaris, M. Sirivianos, X. Yang, and P. Rodriguez Inter-datacenter bulk transfers with netstitcher ACM SIGCOMM Computer Communication Review vol. 41 2011 ACM 74 85
10. Federal Express Developer Resources Center. < http://www.fedex.com/us/ developer/ >.
11. B.B. Chen, and P.B. Primet Scheduling deadline-constrained bulk data transfers to minimize network congestion CCGRID 2007. Seventh IEEE International Symposium on Cluster Computing and the Grid, 2007 2007 IEEE 410 417 (Pubitemid 47334579)
12. K. Rajah, S. Ranka, and Y. Xia Scheduling bulk file transfers with start and end times Comput. Netw. 52 5 2008 1105 1122
13. K. Rajah, S. Ranka, and Y. Xia Advance reservations and scheduling for bulk transfers in research networks IEEE Trans. Parall. Distr. Syst. 20 11 2009 1682 1697
14. N. Laoutaris, G. Smaragdakis, P. Rodriguez, and R. Sundaram Delay tolerant bulk data transfers on the internet Proceedings of the Eleventh International Joint Conference on Measurement and Modeling of Computer Systems 2009 ACM 229 238
15. N. Laoutaris, P. Rodriguez, Good things come to those who (can) wait or how to handle delay tolerant traffic and make peace on the internet, in: Proceedings of ACM HotNets-VII, 2008.
16. S. Iyer, S. Bhattacharyya, N. Taft, N. McKeoen, C. Diot, A Measurement Based Study of Load Balancing in an IP Backbone, Sprint ATL Technical Report TR02-ATL-051027, May 2002.
17. D. Awduche, J. Agogbua, Requirements for traffic engineering over mpls. < http://www.ietf.org/rfc/rfc2702.txt >.
18. Softlayer datacenters map. < http://www.softlayer.com/advantages/ network-overview/ >.
19. M.Z. Shafiq, L. Ji, A.X. Liu, J. Pang, S. Venkataraman, and J. Wang A first look at cellular network performance during crowded events Proceedings of the ACM SIGMETRICS/International Conference on Measurement and Modeling of Computer Systems 2013 ACM 17 28
20. M.Z. Shafiq, L. Ji, A.X. Liu, J. Pang, and J. Wang A first look at cellular machine-to-machine traffic: large scale measurement and characterization Proceedings of the ACM SIGMETRICS Joint International Conference on Measurement and Modeling of Computer Systems 2012 ACM 65 76
21. M.Z. Shafiq, L. Ji, A.X. Liu, J. Pang, and J. Wang Characterizing geospatial dynamics of application usage in a 3g cellular data network INFOCOM, 2012 Proceedings IEEE 2012 IEEE 1341 1349
22. M.Z. Shafiq, L. Ji, A.X. Liu, and J. Wang Characterizing and modeling internet traffic dynamics of cellular devices Proceedings of the ACM SIGMETRICS Joint International Conference on Measurement and Modeling of Computer Systems 2011 ACM 305 316
23. L. Ford Jr, and D. Fulkerson Constructing maximal dynamic flows from static flows Oper. Res. 1958 419 433
24. L. Fleischer, and M. Skutella The quickest multicommodity flow problem Int. Program. Combin. Optimiz. 2006 36 53
25. D. Nace, and M. Pióro Max-min fairness and its applications to routing and load-balancing in communication networks: a tutorial Commun. Surv. Tutor. IEEE 10 4 2008 5 17
26. GNU Linear Programming Kit. < http://www.gnu.org/s/glpk/ >.
27. Y. Feng, B. Li, and B. Li Postcard: minimizing costs on inter-datacenter traffic with store-and-forward 2012 32nd International Conference on Distributed Computing Systems Workshops (ICDCSW) 2012 IEEE 43 50
28. T. Nandagopal, and K.P. Puttaswamy Lowering inter-datacenter bandwidth costs via bulk data scheduling 2012 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid) 2012 IEEE 244 251
29. G. Iosifidis, I. Koutsopoulos, and G. Smaragdakis The impact of storage capacity on end-to-end delay in time varying networks INFOCOM, 2011 Proceedings IEEE 2011 IEEE 1494 1502
30. B. Awerbuch, and T. Leighton Improved approximation algorithms for the multi-commodity flow problem and local competitive routing in dynamic networks Proceedings of the Twenty-Sixth Annual ACM Symposium on Theory of Computing 1994 ACM 487 496
31. L. Georgiadis, P. Georgatsos, K. Floros, and S. Sartzetakis Lexicographically optimal balanced networks IEEE/ACM Trans. Network. 10 6 2002 818 829