FlowMate: Scalable on-line flow clustering

IEEE/ACM Transactions on Networking

Volumn 13, Issue 2, 2005, Pages 288-301

  Younis, Ossama ^a   Fahmy, Sonia ^a  

^a Purdue University   (United States)

Author keywords

Coordinated congestion management; Load balancing; Network monitoring; Network tomography; Shared bottle neck inference; TCP

Indexed keywords

COMPUTER SIMULATION; CONGESTION CONTROL (COMMUNICATION); INTERNET; MONITORING; NETWORK PROTOCOLS; SERVERS; TELECOMMUNICATION TRAFFIC;

COORDINATED CONGESTION MANAGEMENT; LOAD BALANCING; NETWORK MONITORING; NETWORK TOMOGRAPHY; ON LINE FLOW CLUSTERING; SHARED BOTTLENECK INFERENCE;

ONLINE SYSTEMS;

EID: 18844392069     PISSN: 10636692     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNET.2005.845532     Document Type: Article

References (42)

1. K. Harfoush, A. Bestavros, and J. Byers, "PERISCOPE: An active measurement API," in Proc. Passive and Active Measurement Workshop (PAM), Fort Collins, CO, Mar. 2002.
2. (2003) MGEN. [Online]. Available: http://mgen.pf.itd.nrl.navy.mil/
3. (2003). KaZaA. [Online]. Available: http://www.kazaa.com
4. (2003). Gnutella. [Online]. Available: http://www.gnutella.com
5. S. Jin, L. Guo, I. Matta, and A. Bestavros, "The war between mice and elephants," in Proc. IEEE Int. Conf. Network Protocols (ICNP), Nov. 2001, pp. 180-188.
6. S. Ratnasamy, M. Handley, R. Karp, and S. Shenker, "Topologically-aware overlay construction and server selection," in Proc. IEEE INFOCOM, vol. 3, New York, 2002, pp. 1190-1199.
7. H. Balakrishnan and S. Seshan, "An integrated congestion management architecture for Internet hosts," in Proc. ACM SIGCOMM, Cambridge, MA, Sep. 1999, pp. 175-187.
8. V. N. Padmanabhan, "Coordinated congestion management and band-width sharing for heterogeneous data streams," in Proc. 9th Int. Workshop on Network and Operating System Support for Digital Audio and Video (NOSSDAV), Basking Ridge, NJ, 1999.
9. H. Balakrishnan, V. N. Padmanabhan, S. Seshan, M. Stemm, and R. H. Katz, "TCP behavior of a busy Internet server: Analysis and improvements," in Proc. IEEE INFOCOM, vol. 1, Mar./Apr. 1998, pp. 252-262.
10. L. Eggret, J. Heidemann, and J. Touch, "Effects of ensemble-TCP," ACM Comput. Commun. Rev., vol. 30, no. 1, pp. 15-29, Jan. 2000.
11. V. Padmanabhan and R. Katz, "TCP fast start: A technique for speeding up web transfers," in Proc. IEEE GLOBECOM'98 Internet Mini-Conference, Sydney, Australia, Nov. 1998, pp. 41-46.
12. J. Touch, "TCP Control Block Interdependence," IETF, RFC 2140, 1997.
13. S. A. Akella, S. Seshan, and H. Balakrishnan, "The impact of false sharing on shared congestion management," in Proc. 11th IEEE Int. Conf. Network Protocols (ICNP), Nov. 2003, pp. 84-94.
14. R. Caceres, N. Duffield, J. Horowitz, D. Towsley, and T. Bu, "Multicast-based inference of network-internal characteristics: Accuracy of packet loss estimation," in Proc. IEEE INFOCOM, vol. 1, New York, Mar. 1999, pp. 371-379.
15. N. Duffield, F. L. Presti, V. Paxson, and D. Towsley, "Inferring link loss using striped unicast probes," in Proc. IEEE INFOCOM, vol. 2, Anchorage, AK, Apr. 2001, pp. 915-923.
16. K. Harfoush, A. Bestavros, and J. Byers, "Robust identification of shared losses using end-to-end unicast probes," in Proc. IEEE Int. Conf. Network Protocols (ICNP), Oct. 2000, pp. 22-33.
17. D. Katabi, E. Bazzi, and X. Yang, "A passive approach for detecting shared bottlenecks," in Proc. IEEE ICCCN, Oct. 2001, pp. 174-181.
18. D. Rubenstein, J. F. Kurose, and D. F. Towsley, "Detecting shared congestion of flows via end-to-end measurement," in Proc. ACM SIGMETRICS, 2000, pp. 145-155.
19. D. Katabi and C. Blake, "Inferring congestion sharing and path characteristics for packet interarrival times," Mass. Inst. Technol., Cambridge, MA, MIT-LCS-TR-828, 2001.
20. V. Padmanabhan, L. Qiu, and H. J. Wang, "Passive network tomography using Bayesian inference," presented at the Internet Measurements Workshop, Marseille, France, Nov. 2002.
21. O. Younis and S. Fahmy, "On efficient on-line grouping of flows with shared bottlenecks at loaded servers," Purdue Univ., West Lafeyette, IN, Tech. Rep. CSD-TR-02-018, 2002.
22. Handbook of Statistical Methods for Engineers and Scientists, 2nd ed., H. Wadsworth, Ed., McGraw-Hill, New York, 1998.
23. V. Jacobson, R. Braden, and D. Borman, "TCP extensions for high performance," IETF, RFC 1323, 1992.
24. J. Postel, "Transmission Control Protocol," IETF, RFC 793, 1981.
25. H. Chang, R. Gopalakrishna, and V. Prabhakar, "Intelligent grouping of TCP flows for coordinated congestion management," Purdue Univ., West Lafeyette, IN, Tech. Rep. CSD-TR-01-017, 2001.
26. T. Tuan and K. Park, "Multiple time scale congestion control for self-similar network traffic," Perform. Eval., vol. 36, pp. 359-386, 1999.
27. P. Berkhin, "Survey of clustering data mining techniques," Accrue Software, Inc., Tech. Rep., 2002.
28. Y. Zhang, N. Duffield, V. Paxson, and S. Shenker, "On the constancy of Internet path properties," in Proc. ACM SIGCOMM Internet Measurement Workshop (IMW'01), San Francisco, CA, Nov. 2001, pp. 197-211.
29. R. O. Duda, P. E. Hart, and D. G. Stork, Eds., Pattern Classification and Scene Analysis, Part 1: Pattern Classification, 2nd ed. New York: Wiley, 2001.
30. (2001) UCB/LBNL/VINT Network Simulator. ISI. [Online]. Available: http://www.isi.edu/nsnam/ns/
31. M. W. Garrett and W. Willinger, "Analysis, modeling and generation of self-similar VBR video traffic," in Proc. ACM SIGCOMM, London, U.K., 1994, pp. 269-280.
32. M. Allman, "A web server's view of the transport layer," ACM SIGCOMM Comput. Commun. Rev., vol. 30, no. 5, pp. 10-20, Jun. 2000.
33. R. Fielding, J. Gettys, J. Mogul, H. Frystyk, L. Masinter, P. Leach, and T. Berners-Lee, "Hypertext Transfer Protocol - HTTP/1.1," IETF, RFC 2616, 1999.
34. Z. Liu, N. Niclausse, and C. Jalpa-Villaneuva, "Traffic model and performance evaluation of web servers," Perform. Eval., vol. 46, no. 2, pp. 77-100, 2001.
35. P. Barford and M. Crovella, "Generating representative web workloads for network and server performance evaluation," in Proc. 1998 ACM SIGMETRICS Joint Int. Conf. Measurement and Modeling of Computer Systems, Jul. 1998, pp. 151-160.
36. J. Wallerich. (2001) Design and Implementation of WWW workload generator for the ns-2 network simulator. [Online]. Available: http://www.net.uni-sb.de/~jw/nsweb
37. (2002) The Linux Kernel Archives. [Online]. Available: http://www.kernel. org
38. B. White, J. Lepreau, L. Stoller, R. Ricci, S. Gumprasad, M. Newbold, M. Hibler, C. Barb, and A. Joglekar, "An integrated experimental environment for distributed systems and networks," in Proc. 5th Symp. Operating Systems Design and Implementation, Boston, MA, Dec. 2002, pp. 255-270.
39. (2002) TG Traffic Generator. SRI International and USC/ISI Center for Experimental Networking. [Online]. Available: http://www.postel.org/tg/
40. (1999) N. A. Tool for Network Experimentation and Measurement. Univ. of Kansas, Information and Telecommunication Community Ctr. [Online]. Available: http://www.ittc.ku.edu
41. (2003) Planetlab. [Online] Available: http://www.planet-lab.org
42. Pathload P. 1.1.0 (2003, Apr.). [Online]. Available: http://www.cc.gatech.edu/fac/Constantinos.Dovrolis/pathload.html