Markovian modeling of real data traffic: Heuristic phase type and MAP fitting of heavy tailed and fractal like samples

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 2459, Issue , 2002, Pages 405-434

  Horváth, András ^a   Telek, Miklós ^a  

^a BUDAPEST UNIVERSITY OF TECHNOLOGY AND ECONOMICS   (Hungary)

Author keywords

[No Author keywords available]

Indexed keywords

DECAY (ORGANIC); FRACTALS; PACKET SWITCHING;

ANALYSIS APPROACH; EFFECTIVE ANALYSIS; HEAVY-TAILED DISTRIBUTION; MATRIX GEOMETRIC METHODS; NON-MARKOVIAN BEHAVIOR; PACKET SWITCHED DATA; TELECOMMUNICATION INFRASTRUCTURES; TRAFFIC FEATURES;

MARKOV PROCESSES;

EID: 84957077505     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/3-540-45798-4_17     Document Type: Conference Paper

References (52)

1. A. T. Andersen and B. F. Nielsen. A markovian approach for modeling packet traffic with long-range dependence. IEEE Journal on Selected Areas in Communications, 16(5):719–732, 1998.
2. S. Asmussen and O. Nerman. Fitting Phase-type distributions via the EM algorithm. In Proceedings:”Symposium i Advent Statistik”, pages 335–346, Copenhagen, 1991.
3. J. Beran. Statistics for long-memory processes. Chapman and Hall, New York, 1994.
4. A. W. Berger. On the index of dispersion for counts for user demand modeling. In ITU, Madrid, Spain, June 1994. Study Group 2, Question 17/2.
5. A. Bobbio, A. Horváth, M. Scarpa, and M. Telek. Acyclic discrete phase type distributions: Properties and a parameter estimation algorithm. submitted to Performance Evaluation, 2000.
6. S. C. Borst, O. J. Boxma, and R. Nunez-Queija. Heavy tails: The effect of the service discipline. In Tools 2002, pages 1–30, London, England, April 2002. Springer, LNCS 2324.
7. G. E. P. Box, G. M Jenkins, and C. Reinsel. Time Series Analysis: Forecasting and Control. Prentice Hall, Englewood Cliff, N.J., third edition, 1994.
8. E. Castillo. Extreme Value Theory in Engineering. Academic Press, San Diego, California, 1988.
9. M. E. Crovella and M. S. Taqqu. Estimating the heavy tail index from scaling properties. Methodology and Computing in Applied Probability, 1(1):55–79, 1999.
10. A. Cumani. On the canonical representation of homogeneous Markov processes modelling failure-time distributions. Microelectronics and Reliability, 22:583–602, 1982.
11. R. El Abdouni Khayari, R. Sadre, and B. Haverkort. Fitting world-wide web request traces with the EM-algorithm. In Proc. Of SPIE, volume 4523, pages 211–220, Denver, USA, 2001.
12. R. El Abdouni Khayari, R. Sadre, and B. Haverkort. A valiadation of the pseudo self-similar traffic model. In Proc. Of IPDS, Washington D.C., USA, 2002.
13. A. Feldman, A. C. Gilbert, and W. Willinger. Data networks as cascades: Investigating the multifractal nature of internet WAN traffic. Computer communication review, 28/4:42–55, 1998.
14. A. Feldman and W. Whitt. Fitting mixtures of exponentials to long-tail distributions to analyze network performance models. Performance Evaluation, 31:245–279, 1998.
15. W. Fischer and K. Meier-Hellstern. The Markov-modulated Poisson process (MMPP) cookbook. Performance Evaluation, 18:149–171, 1992.
16. H. J. Fowler and W. E. Leland. Local area network traffic characteristics, with implications for broadband network congestion management. IEEE JSAC, 9(7):1139–1149, 1991.
17. R. Fox and M. S. Taqqu. Large sample properties of parameter estimates for strongly dependent stationary time series. The Annals of Statistics, 14:517–532, 1986.
18. C. W. J. Granger and R. Joyeux. An introduction to long-memory time series and fractional differencing. Journal of Time Series Analysis, 1:15–30, 1980.
19. H. Heffes and D. M. Lucantoni. A Markov-modulated characterization of packetized voice and data traffic and related statistical multiplexer performance. IEEE Journal on Selected Areas in Communications, 4(6):856–868, 1986.
20. B. M. Hill. A simple general approach to inference about the tail of a distribution. The Annals of Statistics, 3:1163–1174, 1975.
21. A. Horváth, G. I. Rózsa, and M. Telek. A map fitting method to approximate real traffic behaviour. In 8th IFIP Workshop on Performance Modelling and Evaluation of ATM & IP Networks, pages 32/1–12, Ilkley, England, July 2000.
22. A. Horváth and M. Telek. Approximating heavy tailed behavior with phase type distributions. In 3rd International Conference on Matrix-Analytic Methods in Stochastic models, Leuven, Belgium, 2000.
23. A Horváth and M. Telek. A markovian point process exhibiting multifractal behaviour and its application to traffic modeling. In Proc. Of MAM4, Adelaide, Australia, 2002.
24. A. Horváth and M. Telek. Phfit: A general phase-type fitting tool. In Proc. Of 12 th Performance TOOLS, volume 2324 of Lecture Notes in Computer Science, pages 82–91, Imperial College, London, April 2002.
25. M. Kratz and S. Resnick. The qq–estimator and heavy tails. Stochastic Models, 12:699–724, 1996.
26. A. Lang and J. L. Arthur. Parameter approximation for phase-type distributions. In S. R. Chakravarty and A. S. Alfa, editors, Matrix-analytic methods in stochastic models, Lecture notes in pure and applied mathematics, pages 151–206. Marcel Dekker, Inc., 1996.
27. G. Latouche and V. Ramaswami. Introduction to Matrix-Analytic Methods in Stochastic Modeling. Series on statistics and applied probability. ASA-SIAM, 1999.
28. W. E. Leland, M. Taqqu, W. Willinger, and D. V. Wilson. On the self-similar nature of ethernet traffic (extended version). IEEE/ACM Transactions in Networking, 2:1–15, 1994.
29. D. M. Lucantoni. New results on the single server queue with a batch Markovian arrival process. Commun. Statist.-Stochastic Models, 7(1):1–46, 1991.
30. B. B. Mandelbrot and J. W. Van Ness. Fractional Brownian motions, fractional noises and applications. SIAM Review, 10:422–437, 1969.
31. B. B. Mandelbrot and M. S. Taqqu. Robust R/S analysis of long-run serial correlation. In Proceedings of the 42nd Session of the International Statistical Institute, volume 48, Book 2, pages 69–104, Manila, 1979. Bulletin of the I.S.I.
32. K.S. Meier. A fitting algorithm for Markov-modulated Poisson processes having two arrival rates. European Journal of Operations Research, 29:370–377, 1987.
33. M. Neuts. Probability distributions of phase type. In Liber Amicorum Prof. Emeritus H. Florin, pages 173–206. University of Louvain, 1975.
34. M.F. Neuts. Matrix Geometric Solutions in Stochastic Models. Johns Hopkins University Press, Baltimore, 1981.
35. M.F. Neuts. Structured stochastic matrices of M/G/1 type and their applications. Marcel Dekker, 1989.
36. I. Norros. A storage model with self-similar imput. Queueing Systems, 16:387–396, 1994.
37. I. Norros. On the use of fractional brownian motion in the theorem of connectionless networks. IEEE Journal on Selected Areas in Communications, 13:953–962, 1995.
38. A. Ost and B. Haverkort. Modeling and evaluation of pseudo self-similar traffic with infinite-state stochastic petri nets. In Proc. Of the Workshop on Formal Methods in Telecommunications, pages 120–136, Zaragoza, Spain, 1999.
39. S. Resnick. Heavy tail modeling and teletraffic data. The Annals of Statistics, 25:1805–1869, 1997.
40. S. Resnick and C. Starica. Smoothing the hill estimator. Advances in Applied Probability, 29:271–293, 1997.
41. J. Rice. Mathematical Statistics and Data Analysis. Brooks/Cole Publishing, Pacific Grove, California, 1988.
42. R. H. Riedi. An introduction to multifractals. Technical report, Rice University, 1997. Available at http://www.ece.rice.edu/˜riedi.
43. R. H. Riedi, M. S. Crouse, V. J. Ribeiro, and R. G. Baraniuk. A multifractal wavelet model with application to network traffic. IEEE Transactions on Information Theory, 45:992–1018, April 1999.
44. S. Robert and J.-Y. Le Boudec. New models for pseudo self-similar traffic. Performance Evaluation, 30:1997, 57-68.
45. M. Roughan, D. Veitch, and M. Rumsewicz. Numerical inversion of probability generating functions of power-law tail queues. tech. report, 1997.
46. T. Rydèn. Parameter estimation for Markov Modulated Poisson Processes. Stochastic Models, 10(4):795–829, 1994.
47. T. Ryden. An EM algorithm for estimation in Markov modulated Poisson processes. Computational statist. And data analysis, 21:431–447, 1996.
48. T. Rydèn. Estimating the order of continuous phase-type distributions and markovmodulated poisson processes. Stochastic Models, 13:417–433, 1997.
49. B. Ryu and S. B. Lowen. Point process models for self-similar network traffic, with applications. Stochastic models, 14, 1998.
50. M. Telek and A. Heindl. Moment bounds for acyclic discrete and continuous phase-type distributions of second order. In in proc. Of Eighteenth Annual UK Performance Engineering Workshop (UKPEW), Glasgow, UK, 2002.
51. J. Lèvy Vèhel and R. H. Riedi. Fractional brownian motion and data traffic modeling: The other end of the spectrum. In C. Tricot J. Lèvy Vèhel, E. Lutton, editor, Fractals in Engineering, pages 185–202. Springer, 1997.
52. The internet traffic archive. http://ita.ee.lbl.gov/index.html.