Maelstrom: Transparent error correction for communication between data centers

IEEE/ACM Transactions on Networking

Volumn 19, Issue 3, 2011, Pages 617-629

  Balakrishnan, Mahesh ^a   Marian, Tudor ^b   Birman, Kenneth P ^b   Weatherspoon, Hakim ^b   Ganesh, Lakshmi ^b  

^a MICROSOFT RESEARCH   (United States)

^b Department of Obstetrics Gynecology   (United States)

Author keywords

Data centers; forward error correction (FEC); TCP IP

Indexed keywords

BURSTY LOSS; DATA CENTERS; DISTRIBUTED SYSTEMS; FORWARD ERROR CORRECTION (FEC); FORWARD ERROR CORRECTION SCHEMES; GLOBAL NETWORKS; HIGH PERFORMANCE APPLICATIONS; HIGH-SPEED; LONG-HAUL NETWORKS; LOSS RATES; NETWORK LATENCIES; TCP/IP;

INTERNET PROTOCOLS;

PACKET LOSS;

EID: 79958811552     PISSN: 10636692     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNET.2011.2144616     Document Type: Article

References (45)

1. R. Habel, K. Roberts, A. Solheim, and J. Harley, "Optical domain performance monitoring," in Proc. OFC, Baltimore, MD, 2000, vol. 2, pp. 174-175.
2. "End-to-end performance initiative: When 99% isn't quite enough-Educause bad connection," Internet2, Accessed 2011 [Online]. Available: http://e2epi.internet2.edu/casestudies/ EDUCAUSE/index.html
3. "End-to-end performance initiative: Hey! Where did my performance go? Rate limiting rears its ugly head," Internet2, Accessed 2011 [Online]. Available: http://e2epi.internet2.edu/case-studies/UMich/ index.html
4. A. Kimsas, H. Øverby, S. Bjornstad, and V. L. Tuft, "A cross layer study of packet loss in all-optical networks," in Proc. AICT/ICIW, Guadelope, French Caribbean, 2006, p. 65. (Pubitemid 44460689)
5. D. C. Kilper, R. Bach, D. J. Blumenthal, D. Einstein, T. Landolsi, L. Ostar,M. Preiss, and A. E.Willner, "Optical performance monitoring," J. Lightw. Technol., vol. 22, no. 1, pp. 294-304, Jan. 2004.
6. T. J. Hacker, B. D. Noble, and B. D. Athey, "The effects of systemic packet loss on aggregate TCP flows," in Proc. ACM/IEEE Supercomputing, Baltimore, MD, 2002, pp. 1-15.
7. T. J. Hacker, B. D. Athey, and B. D. Noble, "The end-to-end performance effects of parallel TCP sockets on a lossy wide-area network," in Proc. IPDPS, Fort Lauderdale, FL, 2002, p. 46.2.
8. T. Lakshman and U. Madhow, "The performance of TCP/IP for networks with high bandwidth-delay products and random loss," IEEE/ACM Trans. Netw., vol. 5, no. 3, pp. 336-350, Jun. 1997. (Pubitemid 127768475)
9. J. Padhye, V. Firoiu, D. Towsley, and J. Kurose, "Modeling TCP throughput: A simple model and its empirical validation," SIGCOMM Comput. Commun. Rev., vol. 28, no. 4, pp. 303-314, 1998. (Pubitemid 128566467)
10. D. Katabi, M. Handley, and C. Rohrs, "Congestion control for high bandwidth-delay product networks," in Proc. ACM SIGCOMM, Pittsburgh, PA, 2002, pp. 89-102. (Pubitemid 43843777)
11. L. Rizzo, "Effective erasure codes for reliable computer communication protocols," SIGCOMM Comput. Commun. Rev., vol. 27, no. 2, pp. 24-36, 1997. (Pubitemid 127566056)
12. C. Huitema, "The case for packet level FEC," in Proc. 5th Int. Workshop Protocols High-Speed Netw., Sophia Antipolis, France, 1997, pp. 109-120.
13. M. Balakrishnan, K. Birman, A. Phanishayee, and S. Pleisch, "Ricochet: Lateral error correction for time-critical multicast," in Proc. NSDI, Boston, MA, 2007, pp. 73-86.
14. J. Border, M. Kojo, J. Griner, G. Montenegro, and Z. Shelby, "Performance enhancing proxies intended to mitigate link-related degradations," Internet RFC3135, Jun. 2001.
15. "Riverbed steelhead appliances," Riverbed Technology, San Francisco, CA [Online]. Available: http://www.riverbed.com/products/
16. "Blue Coat product suite," Blue Coat, Sunnyvale, CA [Online]. Available: http://www.bluecoat.com/products/overview
17. B. White, J. Lepreau, L. Stoller, R. Ricci, S. Guruprasad, M. Newbold, M. Hibler, C. Barb, and A. Joglekar, "An integrated experimental environment for distributed systems and networks," in Proc. OSDI, Boston, MA, 2002, pp. 255-270.
18. L. James, A. Moore, M. Glick, and J. Bulpin, "Physical layer impact upon packet errors," presented at the PAM, Adelaide, Australia, 2006.
19. "TeraGrid," 2008 [Online]. Available: http://www.teragrid.org
20. "Teragrid UDP performance," 2008 [Online]. Available: https://network.teragrid.org/tgperf/udp/
21. P. Wefel, Private communication with network engineer National Center for Supercomputing Applications (NCSA), University of Illinois, Urbana, IL, Feb. 2008.
22. "Global crossing current network performance," Global Crossing, Hamilton, Bermuda, 2008 [Online]. Available: http://www. globalcrossing.com/ network/network-performance-current.aspx
23. "Qwest IP network statistics," Qwest, Denver, CO, 2008 [Online]. Available: http://stat.qwest.net/statqwest/statistics-tp.jsp
24. D. Comer and T. Boures, Private communication with vice president of research and senior engineer Cisco Systems, Inc., San Jose, CA, Oct. 2007.
25. D. Wei, C. Jin, S. Low, and S. Hegde, "FAST TCP: Motivation, architecture, algorithms, performance," IEEE/ACM Trans. Netw., vol. 14, no. 6, pp. 1246-1259, Dec. 2006.
26. C. Parsa and J. J. Garcia-Luna-Aceves, "Differentiating congestion vs. random loss: A method for improving TCP performance over wireless links," in Proc. 2nd IEEE WCNC, Chicago, IL, 2000, vol. 1, pp. 90-93. (Pubitemid 35209880)
27. R. Krishnan, J. Sterbenz, W. Eddy, C. Partridge, and M. Allman, "Explicit transport error notification (ETEN) for error-prone wireless and satellite networks," Comput. Netw., vol. 46, no. 3, pp. 343-362, 2004.
28. K. Park and W. Wang, "AFEC: An adaptive forward error correction protocol for end-to-end transport of real-time traffic," in Proc. 7th ICCCN, Lafayette, LA, 1998, pp. 196-207.
29. J. Nonnenmacher, E. Biersack, and D. Towsley, "Parity-based loss recovery for reliable multicast transmission," in Proc. ACM SIGCOMM, Cannes, France, 1997, pp. 289-300. (Pubitemid 127568368)
30. J. Hurwitz and W. Feng, "Initial end-to-end performance evaluation of 10-Gigabit Ethernet," in Proc. 11th Hot Interconnects, Stanford, CA, 2003, pp. 116-121.
31. H. Lundqvist and G. Karlsson, "TCP with end-to-end forward error correction," in Proc. IZS, Zurich, Switzerland, 2004, pp. 152-155.
32. H. Sivakumar, S. Bailey, and R. L. Grossman, "PSockets: The case for application-level network striping for data intensive applications using high speed wide area networks," in Proc. ACM/IEEE Supercomputing, Dallas, TX, 2000, Article no. 37.
33. S.Wallace, "Tsunami file transfer protocol," presented at the PFLDNet, Geneva, Switzerland, 2003.
34. E. He, J. Leigh, O. Yu, and T. A. DeFanti, "Reliable blast UDP: Predictable high performance bulk data transfer," in Proc. IEEE Cluster, Chicago, IL, 2002, pp. 317-324.
35. S. Wicker and V. Bhargava, Reed-Solomon Codes and Their Applications. New York: Wiley, 1999.
36. "netfilter: Firewalling, NAT and packet mangling for Linux," netfilter, Berlin, Germany, 2008 [Online]. Available: http:// www.netfilter.org/
37. A. Tirumala, F. Qin, J. Dugan, J. Ferguson, and K. Gibbs, "Iperf-The TCP/UDP bandwidth measurement tool," 2004 [Online]. Available: http://iperf.sourceforge.net
38. K. Song, Q. Zhang, and M. Sridharan, "Compound TCP:Ascalable and TCP-friendly congestion control for high-speed networks," presented at the PFLDnet 2006.
39. I. Rhee and L. Xu, "CUBIC: A new TCP-friendly high-speed TCP variant," presented at the PFLDNet Lyon, France, 2005.
40. N. Shacham and P. McKenney, "Packet recovery in high-speed networks using coding and buffer management," in Proc. IEEE INFOCOM, San Francisco, CA, 1990, vol. 1, pp. 124-131.
41. E. Biersack, "Performance evaluation of forward error correction in ATM networks," in Proc. ACM SIGCOMM, Baltimore, MD, 1992, pp. 248-257. (Pubitemid 23630415)
42. R. Gallager and L. Codes, "Cambridge," 1963.
43. M. Luby, M. Mitzenmacher, M. A. Shokrollahi, and D. A. Spielman, "Efficient erasure correcting codes," IEEE Trans. Inf. Theory, vol. 47, no. 2, pp. 569-584, Feb. 2001. (Pubitemid 32318090)
44. M. Luby, "LT codes," in Proc. 43rd Annu. IEEE FOCS,Vancouver, BC, 2002, pp. 271-280.
45. A. Shokrollahi, "Raptor codes," IEEE Trans. Inf. Theory, vol. 52, no. 6, pp. 2551-2567, Jun. 2006.