Energy-aware data transfer algorithms

International Conference for High Performance Computing, Networking, Storage and Analysis, SC

Volumn 15-20-November-2015, Issue , 2015, Pages

  Alan, Ismail ^a   Arslan, Engin ^a   Kosar, Tevfik ^a  

^a the State University of New York   (United States)

Author keywords

big data; energy efficiency; energy aware data transfers; power modeling; protocol tuning

Indexed keywords

ALGORITHMS; DATA TRANSFER; DIGITAL STORAGE; ENERGY CONSERVATION; ENERGY EFFICIENCY; ENERGY UTILIZATION; INFORMATION MANAGEMENT; POWER MANAGEMENT; POWER MANAGEMENT (TELECOMMUNICATION);

DESTINATION NODES; ENERGY AWARE; ESTIMATED COSTS; NETWORKING INFRASTRUCTURE; POWER CONSUMED; POWER MANAGEMENT TECHNIQUES; POWER MODEL; PROTOCOL TUNING;

BIG DATA;

EID: 84966586508     PISSN: 21674329     EISSN: 21674337     Source Type: Conference Proceeding    
DOI: 10.1145/2807591.2807628     Document Type: Conference Paper

References (50)

1. The extreme science and engineering discovery environment (xsede). https://www.xsede.org/.
2. Futuregrid testbed. http://www.futuregrid.org.
3. IEEE energy efficient ethernet standards. 10.1109/IEEESTD.2010.5621025, Oct. 2010.
4. I. Alan, E. Arslan, and T. Kosar. Energy-aware data transfer tuning. In Cluster, Cloud and Grid Computing (CCGrid), 2014 14th IEEE/ACM International Symposium on, pages 626-634. IEEE, 2014.
5. I. Alan, E. Arslan, and T. Kosar. "energy-performance trade-offs in data transfer tuning at the end-systems". Sustainable Computing: Informatics and Systems, 2014.
6. B. Allen, J. Bresnahan, L. Childers, I. Foster, G. Kandaswamy, R. Kettimuthu, J. Kordas, M. Link, S. Martin, K. Pickett, and S. Tuecke. Software as a service for data scientists. Communications of the ACM, 55:2:81-88, 2012.
7. E. Altman and D. Barman. Parallel tcp sockets: Simple model, throughput and validation. In Proceedings of IEEE INFOCOM, 2006.
8. G. Ananthanarayanan and R. Katz. Greening the switch. In In Proceedings ofHotPower, December 2008.
9. S. Antonakopoulos, S. Fortune, and L. Zhang. Power-aware routing with rate-adaptive network elements. In GLOBECOM Workshops (GC Wkshps), 2010 IEEE, pages 1428-1432. IEEE, 2010.
10. E. Arslan, B. Ross, and T. Kosar. Dynamic protocol tuning algorithms for high performance data transfers. In Euro-Par 2013 Parallel Processing, pages 725-736. Springer, 2013.
11. J. Bresnahan, M. Link, R. Kettimuthu, D. Fraser, and I. Foster. Gridftp pipelining. In Proceedings of TeraGrid, 2007.
12. D. Brooks, V. Tiwari, and M. Martonosi. Wattch: a framework for architectural-level power analysis and optimizations. In Proceedings of the 27th annual international symposium on Computer architecture, ISCA '00, pages 83-94, New York, NY, USA, 2000. ACM.
13. J. Chabarek, J. Sommers, P. Barford, C. Estan, D. Tsiang, and S. Wright. Power awareness in network design and routing. In In Proceedings of IEEE INFOCOM, April, 2008.
14. G. Contreras and M. Martonosi. Power prediction for intel xscale® processors using performance monitoring unit events. In ISLPED'05, pages 221-226, 2005.
15. DIDCLab. Data intensive distributed computing laboratoy. http://www.didclab.org.
16. D. Economou, S. Rivoire, C. Kozyrakis, and P. Ranganathan. Full-system power analysis and modeling for server environments. In Proc. of Workshop on Modeling, Benchmarking, and Simulation, 2006.
17. X. Fan, W.-D. Weber, and L. A. Barroso. Power provisioning for a warehouse-sized computer. ACM SIGARCH Computer Architecture News, 35(2):13-23, 2007.
18. K. Farkas, P. Huang, B. Krishnamurthy, Y. Zhang, and J. Padhye. Impact of tcp variants on http performance. Proceedings ofHigh Speed Networking, 2, 2002.
19. N. Freed. SMTP service extension for command pipelining. http://tools.ietf.org/html/rfc2920.
20. E. Goma, M. C. A. L. Toledo, N. Laoutaris, D. Kosti, P. Rodriguez, R. Stanojev, and P. Y. Valentin. Insomnia in the access or how to curb access network related energy consumption. In In Proceedings of ACM SIGCOMM 2011.
21. A. Greenberg, J. Hamilton, D. Maltz, and P. Patel. The cost of a cloud: Research problems in data center networks. In In ACM SIGCOMM CCR, January 2009.
22. A. Greenberg, P. Lahiri, D. A. Maltz, P. Patel, and S. Sengupta. Towards a next generation data center architecture: Scalability and commoditization. In In ACM PRESTO, pages 57AR62, 2008.
23. M. Gupta and S. Singh. Energy conservation with low power modes in ethernet lan environments. In IEEE INFOCOM (MiniSymposium) 2007.
24. M. Gupta and S. Singh. Greening of the internet. In ACM SIGCOMM, pages 19AR26, 2003.
25. S. Gurumurthi, A. Sivasubramaniam, M. J. Irwin, N. Vijaykrishnan, and M. Kandemir. Using complete machine simulation for software power estimation: The softwatt approach. In Prpc. of8th High-Performance Computer Architecture Symp., pages 141-150, 2002.
26. T. J. Hacker, B. D. Noble, and B. D. Atley. Adaptive data block scheduling for parallel streams. In Proceedings of HPDC '05, pages 265-275. ACM/IEEE, July 2005.
27. K. Hasebe, T. Niwa, A. Sugiki, and K. Kato. Power-saving in large-scale storage systems with data migration. In IEEE CloudCom 2010.
28. B. Heller, S. Seetharaman, P. Mahadevan, Y. Yiakoumis, P. Sharma, S. Banerjee, and N. McKeown. Elastictree: Saving energy in data center networks. In Proceedings ofNSDI 2010.
29. M. Jain, R. S. Prasad, and C. Dovrolis. The tcp bandwidth-delay product revisited: network buffering, cross traffic, and socket buffer auto-sizing. 2003.
30. D. A. Joseph, A. Tavakoli, and I. Stoica. A policy-aware switching layer for data centers. In SIGCOMM CCR 38(4):51AR62, 2008.
31. R. Koller, A. Verma, and A. Neogi. Wattapp: an application aware power meter for shared data centers. In Proceedings of the 7th international conference on Autonomic computing, pages 31-40. ACM, 2010.
32. W. Liu, B. Tieman, R. Kettimuthu, and I. Foster. A data transfer framework for large-scale science experiments. In Proceedings ofDIDC Workshop, 2010.
33. D. Lu, Y. Qiao, P. A. Dinda, and F. E. Bustamante. Modeling and taming parallel tcp on the wide area network. In Parallel and Distributed Processing Symposium, 2005. Proceedings. 19th IEEE International, pages 68b-68b. IEEE, 2005.
34. P. Mahadevan, P. Sharma, S. Banerjee, and P. Ranganathan. A power benchmarking framework for network devices. In In Proceedings of IFIP Networking, May 2009.
35. S. Nedevschi, L. Popa, G. Iannaccone, S. Ratnasamy, and D. Wether-all. Reducing network energy consumption via rate-adaptation and sleeping. In Proceedings Of NSDI, April 2008.
36. U. of Minnesota. Minnesota internet traffic studies (mints), 2012.
37. R. S. Prasad, M. Jain, and C. Dovrolis. Socket buffer auto-sizing for high-performance data transfers. Journal of GRID computing, 1(4):361-376, 2003.
38. F. Rawson and I. Austin. Mempower: A simple memory power analysis tool set. IBM Austin Research Laboratory, 2004.
39. S. Rivoire, P. Ranganathan, and C. Kozyrakis. A comparison of high-level full-system power models. HotPower, 8:3-3, 2008.
40. J. Semke, J. Mahdavi, and M. Mathis. Automatic tcp buffer tuning. ACM SIGCOMM Computer Communication Review, 28(4):315-323, 1998.
41. L. Shang, L.-S. Peh, and N. K. Jha. Dynamic voltage scaling with links for power optimization of interconnection networks. In High-Performance Computer Architecture, 2003. HPCA-9 2003. Proceedings. The Ninth International Symposium on, pages 91-102. IEEE, 2003.
42. Y. Shang, D. Li, and M. Xu. A comparison study of energy proportionality of data center network architectures. In Distributed Computing Systems Workshops (ICDCSW), 2012 32nd International Conference on, pages 1-7. IEEE, 2012.
43. C. Systems. Visual networking index: Forecast and methodology, 201302018, June 2014.
44. W. Van Heddeghem, F. Idzikowski, E. Le Rouzic, J. Y. Mazeas, H. Poignant, S. Salaun, B. Lannoo, and D. Colle. Evaluation of power rating of core network equipment in practical deployments. In Online Conference on Green Communications (GreenCom), 2012 IEEE, pages 126-132. IEEE, 2012.
45. A. Vishwanath, K. Hinton, R. Ayre, and R. Tucker. Modelling energy consumption in high-capacity routers and switches. 2014.
46. S. V. Vrbsky, M. Galloway, R. Carr, R. Nori, and D. Grubic. Decreasing power consumption with energy efficient data aware strategies. FGCS, 29(5):1152-1163, 2013.
47. E. Yildirim, J. Kim, and T. Kosar. How gridftp pipelining, parallelism and concurrency work: A guide for optimizing large dataset transfers. In High Performance Computing, Networking, Storage and Analysis (SCC), 2012 SC Companion:, pages 506-515. IEEE, 2012.
48. E. Yildirim and T. Kosar. Network-aware end-to-end data throughput optimization. In Proceedings of Network-Aware Data Management Workshop (NDM 2011).
49. E. Yildirim, D. Yin, and T. Kosar. Balancing tcp buffer vs parallel streams in application level throughput optimization. In Proceedings of DADC Workshop, 2009.
50. J. Zedlewski, S. Sobti, N. Garg, F. Zheng, A. Krishnamurthy, and R. Y. Wang. Modeling hard-disk power consumption. In FAST 2003.