CoRE: Cooperative End-to-End Traffic Redundancy Elimination for Reducing Cloud Bandwidth Cost

IEEE Transactions on Parallel and Distributed Systems

Volumn 28, Issue 2, 2017, Pages 446-461

  Yu, Lei ^a   Shen, Haiying ^c   Sapra, Karan ^c   Ye, Lin ^d   Cai, Zhipeng ^b  

^a Georgia Institute of Technology   (United States)

^b GEORGIA STATE UNIVERSITY   (United States)

^c AMRL   (United States)

^d HARBIN INSTITUTE OF TECHNOLOGY   (China)

Author keywords

bandwidth cost; cloud computing; end to end; network bandwidth; Traffic redundancy elimination

Indexed keywords

BANDWIDTH; CLOUD COMPUTING; COSTS; DISTRIBUTED COMPUTER SYSTEMS; EFFICIENCY; FORECASTING; REDUNDANCY;

ADAPTIVE PREDICTIONS; CLOUD APPLICATIONS; CLOUD ENVIRONMENTS; COOPERATIVE OPERATION; EFFECTIVE SOLUTION; END TO END; NETWORK BANDWIDTH; REDUNDANCY ELIMINATION;

COST REDUCTION;

EID: 85009999820     PISSN: 10459219     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPDS.2016.2578928     Document Type: Article

References (28)

1. M. Armbrust, A. Fox, R. Griffith, A. D. Joseph, R. Katz, A. Konwinski, G. Lee, D. Patterson, A. Rabkin, I. Stoica, and M. Zaharia, "A view of cloud computing," Commun. ACM, vol. 53, no. 4, pp. 50-58, Apr. 2010.
2. N. R. Herbst, S. Kounev, and R. Reussner, "Elasticity in cloud computing: What it is, and what it is not," in Proc. ICAC. San Jose, CA: USENIX, 2013, pp. 23-27.
3. "Netflix," [Online]. Available: www.netflix.com, (accessed on 17-Jun-2016).
4. "Amazon elastic compute cloud (EC2)," [Online]. Available: http://aws.amazon.com, (accessed on 17-Jun-2016).
5. "The hidden cost of the cloud: Bandwidth charges," [Online]. Available: http://gigaom.com/2009/07/17/the-hidden-cost-ofthe-cloud-bandwidth-charges, (accessed on 17-Jun-2016).
6. "The real costs of cloud computing," [Online]. Available: http://www.computerworld.com/article/2550226/data-center/the-realcosts-of-cloud-computing.html, (accessed on 17-Jun-2016).
7. E. Zohar, I. Cidon, and O. O. Mokryn, "The power of prediction: cloud bandwidth and cost reduction," in Proc. ACM Spec. Int. Group Data Commun., 2011, pp. 86-97.
8. N. T. Spring and D. Wetherall, "A protocol-independent technique for eliminating redundant network traffic," in Proc. ACM Spec. Int. Group Data Commun., 2000, pp. 87-95.
9. B. Agarwal, A. Akella, A. Anand, A. Balachandran, P. Chitnis, C. Muthukrishnan, R. Ramjee, and G. Varghese, "Endre: An endsystem redundancy elimination service for enterprises," in Proc. National Spatial Data Infrastruct., 2010, pp. 419-432.
10. E. Zohar, I. Cidon, and O. Mokryn, "Pack: Prediction-based cloud bandwidth and cost reduction system," IEEE/ACM Trans. Netw., vol. 22, no. 1, pp. 39-51, Feb. 2014.
11. A. Anand, C. Muthukrishnan, A. Akella, and R. Ramjee, "Redundancy in network traffic: findings and implications," in Proc. SIGMETRICS/Performance, 2009, pp. 37-48.
12. M. Rabin, "Fingerprinting by random polynomials," Technical report Harvard University, Cambridge, MIT, vol. 15-81, 1981.
13. "Riverbed networks : Wan optimization." [Online]. Available: http://www.riverbed.com/solutions/wan-optimization.html, (accessed on 17-Jun-2016).
14. "Juniper networks: Application acceleration." [Online]. Available: http://www.juniper.net/techpubs/en-US/release-independent/jwos/information-products/pathway-pages/wx-series/product/, (accessed on 17-Jun-2016)
15. "Cisco wide area application services," [Online]. Available: http://www.cisco.com/c/en/us/products/routers/wide-areaapplication-services-waas-software/index.html, (accessed on 17-Jun-2016).
16. A. Anand, A. Gupta, A. Akella, S. Seshan, and S. Shenker, "Packet caches on routers: the implications of universal redundant traffic elimination," in Proc. ACM Spec. Int. Group Data Commun. ACM, 2008, pp. 219-230.
17. A. Anand, V. Sekar, and A. Akella, "Smartre: an architecture for coordinated network-wide redundancy elimination," in Proc. ACM Spec. Int. Group Data Commun. ACM, 2009, pp. 87-98.
18. "Paas." [Online]. Available: http://www.ibm.com/cloud-computing/us/en/paas.html, (accessed on 17-Jun-2016).
19. "Dropbox." [Online]. Available: www.dropbox.com, (accessed on 17-Jun-2016).
20. S.-H. Shen, A. Gember, A. Anand, and A. Akella, "Refactor-ing content overhearing to improve wireless performance," in Proc. 17th Annu. Int. Conf. Mobile Comput. Netw., ser. Mobi Com '11. New York, NY, USA: ACM, 2011, pp. 217-228. [Online]. Available: http://doi.acm.org/10.1145/2030613.2030638
21. E. Zohar, I. Cidon, and O. O. Mokryn, "Celleration: Loss-resilient traffic redundancy elimination for cellular data," in Proc. Twelfth Workshop Mobile Comput. Syst. & #38; Appl., ser. Hot Mobile '12. New York, NY, USA: ACM, 2012, pp. 10:1-10:6. [Online]. Available: http://doi.acm.org/10.1145/2162081.2162096
22. S. Woo, E. Jeong, S. Park, J. Lee, S. Ihm, and K. Park, "Comparison of caching strategies in modern cellular backhaul networks," in Proc.11th Annu. Int. Conf. Mobile Syst., Appl. Serv., ser. Mobi Sys '13. New York, NY, USA: ACM, 2013, pp. 319-332. [Online]. Available: http://doi.acm.org/10.1145/2462456.2464442
23. Y. Zhang and N. Ansari, "On protocol-independent data redundancy elimination," Commun. Surv. Tutorials, IEEE, vol. 16, no. 1, pp. 455-472, Feb. 2014.
24. S. Ihm, K. Park, and V. S. Pai, "Wide-area network acceleration for the developing world," in Proc. USENIX annual technical conference. USENIX Association, 2010, pp. 18-18.
25. G. Wright and W. Stevens., TCP/IP Illustrated, Volume2: The Implementation., Boston, Massachusetts: Addison-Wesley, 1995.
26. L. Yu, K. Sapra, H. Shen, and L. Ye, "Cooperative end-to-end traffic redundancy elimination for reducing cloud bandwidth cost," in Proc. of Int. Conf. Netw. Protocols, ser. ICNP '12. Washington, DC, USA:, 2012, pp. 1-10. [Online]. Available: http://dx.doi.org/10.1109/ICNP.2012.6459973
27. "Pack source code,"[Online]. Available: http://www.venus-c.eu/pages/partner.aspx?id=10, (accessed on 17-Jun-2016).
28. "netfilter/iptables:libnetfilter-queue," [Online]. Available: http://www.netfilter.org/projects/libnetfilter-queue, Oct 2005