Self-similarity through high-variability: Statistical analysis of Ethernet LAN traffic at the source level

IEEE/ACM Transactions on Networking

Volumn 5, Issue 1, 1997, Pages 71-86

  Willinger, Walter ^a,e   Taqqu, Murad S ^b,e   Sherman, Robert ^c   Wilson, Daniel V ^d,e  

^a AT AND T LABS RESEARCH   (United States)

^b Boston University   (United States)

^c CALIFORNIA INSTITUTE OF TECHNOLOGY   (United States)

^d TELCORDIA TECHNOLOGIES   (United States)

^e IEEE   (United States)

Author keywords

Fractional Gaussian noise; Infinite variance; LAN traffic measurements; Long range dependence; Packet train model; Self similarity

Indexed keywords

CORRELATION THEORY; MATHEMATICAL MODELS; NETWORK PROTOCOLS; PACKET NETWORKS; REAL TIME SYSTEMS; SPURIOUS SIGNAL NOISE; STATISTICAL METHODS; TELECOMMUNICATION TRAFFIC;

JOSEPH EFFECT; NOAH EFFECT; PACKET TRAIN MODEL; REAL TIME TRAFFIC MEASUREMENTS;

LOCAL AREA NETWORKS;

EID: 0031078972     PISSN: 10636692     EISSN: None     Source Type: Journal    
DOI: 10.1109/90.554723     Document Type: Article

References (54)

1. T. Berners-Lee, R. Cailliau, A. Loutonen, H. F. Nielsen, and A. Secret, "The World-Wide Web," Commun, ACM, vol. 37, pp. 76-82, 1994.
2. N. H. Bingham, C. M. Goldie, and J. L. Teugels, Regular Variation. Cambridge, U.K.: Cambridge University Press, 1987.
3. F. Brichet, J. Roberts, A. Simonian, and D. Veitch, "Heavy traffic analysis of a fluid queue fed by on/off sources with long-range dependence," Preprint, 1995.
4. D. R. Cox, Renewal Theory. London, U.K.: Methuen & Co., 1967.
5. _, "Long-range dependence: a review," in Statistics: An Appraisal, H.A. David and H.T. David, Eds. Ames, IA: Iowa State University Press, 1984, pp. 55-74.
6. M. E. Crovella and A. Bestavros, "Self-similarity in world wide web traffic: evidence and possible causes," in Proc. 1996 ACM SIGMETRICS. Int. Conf. Meas. Model. Comput. Syst., May 1996.
7. P. Danzig, S. Jamin, R. C\'aceres, D. Mitzel, and D. Estrin, "An empirical workload model for driving wide-area TCP/IP network simulations," Internetworking: Res. Exper., vol. 3, pp. 1-26, 1992.
8. N. G. Duffield, "Economies of scale in queues with sources having power-law large deviation scalings," Preprint, 1994.
9. N. G. Duffield and N. O'Connell, "Large deviations and overflow probabilities for the general single-server queue, with applications," in Math, Proc. Cambridge Philos. Soc., 1995, pp. 363-375.
10. A. I. Elwalid and D. Mitra, "Effective bandwidths of general Markovian sources and admission control of high speed networks," IEEE/ACM Trans. Networking, vol. 1, pp. 329-343, 1993.
11. H. Eriksson, "Mbone: the multicast backbone," Commun. ACM, vol. 37, pp. 54-60, 1994.
12. A. Erramilli, O. Narayan, and W. Willinger, "Experimental queueing analysis with long-range dependent traffic," IEEE/ACM Trans. Networking, vol. 4, pp. 209-223, 1996.
13. W. Feller, An Introduction to Probability Theory and its Applications. New York: Wiley, 1971.
14. R. Gusella, "A characterization of the variability of packet arrival processes in workstation networks," Ph.D. dissertation, Univ. of California, Berkeley, 1990.
15. _, "A measurement study of diskless workstation traffic on an Ethernet," IEEE Trans. Commun., vol. 38, pp. 1557-1568, 1990.
16. _, "Characterizing the variability of arrival processes with indexes of dispersion," IEEE J. Select. Areas Commun., vol. 9, pp. 203-211, 1991.
17. D. Heath, S. Resnick, and G. Samorodnitsky, "Heavy tails and long-range dependence in on/off processes and associated fluid models," School of ORIE, Cornell University, Ithaca, NY, Preprint, 1996.
18. B. M. Hill, "A simple general approach to inference about the tail of a distribution," Ann. Statistics, vol. 3, pp. 1163-1174, 1975.
19. R. Jain and S. A. Routhier, "Packet trains: measurements and a new model for computer network traffic," IEEE J. Select. Areas Commun., vol. 4, pp. 986-995, 1986.
20. S. Jamin, P. B. Danzig, S. Shenker, and L. Zhang, "A measurement-based admission control algorithm for integrated services packet networks," ACM/SIGCOMM Comput. Commun. Rev., vol. 25, pp. 2-13, 1995.
21. S. Karlin and H. M. Taylor, A First Course in Stochastic Processes. New York: Academic, 1975.
22. S. M. Klivansky, A. Mukherjee, and C. Song, "On long-range dependence in NSFNET traffic," Preprint, 1994.
23. M. F. Kratz and S. I. Resnick, "The QQ-estimator and heavy tails," Preprint, 1995.
24. K. R. Krishnan, "The Hurst parameter of non-Markovian on-off traffic sources," Preprint, 1995.
25. T. G. Kurtz, "Limit theorems for workload input models," in Stochastic Networks: Theory and Applications, F. P. Kelly, S. Zachary, and I. Ziedins, Eds. Oxford, U.K.: Oxford Univ. Press, 1996.
26. W. E. Leland and T. J. Ott, "UNIX Process Behavior and Load balancing among loosely-coupled computers," in Teletraffic Analysis and Computer Performance Evaluation, O. J. Boxma, J. W. Cohen, and H. C. Tijms, Eds. Amsterdam, The Netherlands: Elsevier, 1986, pp. 191-208.
27. W. E. Leland, M. S. Taqqu, W. Willinger, and D. V. Wilson, "On the self-similar nature of ethernet traffic," ACM/SIGCOMM Computer Commun. Rev., vol. 23, pp. 183-193, 1993.
28. W. E. Leland, M. S. Taqqu, W. Willinger, and D. V. Wilson, "On the Self-similar nature of Ethernet traffic (extended version)," IEEE/ACM Trans. Networking, vol. 2, pp. 1-15, 1994.
29. S. B. Lowen and M. C. Teich, "Fractal renewal processes generate 1/f noise," Physical Rev. E, vol. 47, pp. 992-1001, 1993.
30. B. B. Mandelbrot, "Self-similar error clusters in communication systems and the concept of conditional stationarity," IEEE Trans. Commun. Technol., vol. 13, pp. 71-90, 1965.
31. B. B. Mandelbrot, "Long-run linearity, locally Gaussian processes, H-spectra and infinite variances," Int. Economic Rev., vol. 10, pp. 82-113, 1969.
32. B. B. Mandelbrot, The Fractal Geometry of Nature. New York: Freeman, 1983.
33. B. B. Mandelbrot and J. R. Wallis, "Some long-run properties of geophysical records," Water Resources Res., vol. 5, pp. 321-340, 1969.
34. K. Meier-Hellstern, P. E. Wirth, Y.-L. Yan, and D. A. Hoeflin, "Traffic models for ISDN data users: office automation application," in Teletraffic and Datatraffic in a Period of Change, Proc. ITC13, Copenhagen, A. Jensen and V. B. Iversen, Eds. Amsterdam, The Netherlans: Elsevier, 1991, pp. 167-172.
35. I. Norros, "A storage model with self-similar input," Queueing Syst., vol. 16, pp. 387-396, 1994.
36. V. Paxson, "Growth trends in wide-area TCP connections," IEEE Network, vol. 8, pp. 8-17, 1994.
37. V. Paxson and S. Floyd, "Wide-area traffic: The failure of poisson modeling," in Proc. ACM/SIGCOMM'94, pp. 257-268.
38. _, "Wide-area traffic: the failure of Poisson modeling," IEEE/ACM Trans. Networking, vol. 3, pp. 226-244, 1995.
39. P. Pruthi and A. Erramilli, "Heavy-tailed on/off source behavior and self-similar traffic," in Proc. ICC '95, Seattle, WA, 1995, pp. 445-450.
40. S. I. Resnick, "Heavy tail modeling and teletraffic data," School of ORIE, Cornell Univ., Ithaca, NY, Preprint, 1995.
41. S. I. Resnick and C. Starcia, "Smoothing the Hill estimator," Preprint, 1995.
42. G. Samorodnitsky and M. S. Taqqu, Stable Non-Gaussian Processes: Stochastic Models with Infinite Variance. London, U.K.: Chapman and Hall, 1994.
43. D. F. Swayne, D. Cook, and A. Buja, "XGobi: interactive dynamic graphics in the X window system with a link to S," in 1991 Proc. Statistical Graphics, 1991, pp. 1-8.
44. M. S. Taqqu, "A bibliographical guide to self-similar processes and long-range dependence," in Dependence in Probability and Statistics, E. Eberlein and M. S. Taqqu, Eds. Boston, MA: Birkhäuser, 1986, pp. 137-162.
45. M. S. Taqqu, "Weak convergence to fractional Brownian motion and to the Rosenblatt process," Zeitschrift für Wahrscheinlichkeitstheorie und verwandte Gebiete, vol. 31, pp. 287-302, 1975.
46. M. S. Taqqu and J. Levy, "Using renewal processes to generate long-range dependence and high variability," in Dependence in Probability and Statistics, E. Eberlein and M. S. Taqqu, Eds. Boston, MA: Birkhäuser, 1986, pp. 73-89.
47. M. S. Taqqu and V. Teverovsky, and W. Willinger, "Is network traffic self-similar or multifractal?" Fractals, 1996.
48. J. L. Teugels, "Renewal theorems when the first or the second moment is infinite," The Annal. Math. Statistics, vol. 39, pp. 1210-1219, 1968.
49. V. Teverovsky and M. S. Taqqu, Testing for Long-Range "Dependence in the presence of shifting means or a slowly declining trend using a variance-type estimator," Preprint, 1995.
50. J. W. Tukey and P. A. Tukey, "Strips displaying empirical distributions: I. textured dot strips," Bellcore Tech. Memo., 1990.
51. W. Willinger, M. S. Taqqu, W. E. Leland, and V. Wilson, "Self-similarity in high-speed packet traffic: analysis and modeling of Ethernet traffic measurements," Statistical Sci., vol. 10, pp. 67-85, 1995.
52. W. Willinger, M. S. Taqqu, R. Sherman, and D. V. Wilson, "Self-similarity through high-variability: statistical analysis of Ethernet LAN traffic at the source level," Computer Commun. Rev., vol. 25, pp. 100-113, 1995.
53. W. Willinger, M. S. Taqqu, and A. Erramilli, "A bibliographical guide to self-similar traffic and performance modeling for modern high-speed networks," in Stochastic Networks: Theory and Applications, F. P. Kelly, S. Zachary and I. Ziedins, Eds. Oxford, U.K.: Oxford Univ. Press, 1996.
54. W. Willinger, M. S. Taqqu, and R. Sherman, "Proof of a fundamental result in self-similar traffic modeling," Computer Commun. Rev., to appear.