Trace data characterization and fitting for Markov modeling

Performance Evaluation

Volumn 67, Issue 2, 2010, Pages 61-79

  Casale, Giuliano ^a   Zhang, Eddy Z ^b   Smirni, Evgenia ^b  

^a SAP Research   (United Kingdom)

^b The College of William and Mary   (United States)

Author keywords

Correlations; Fitting algorithm; Markovian arrival process; Temporal dependence; Time series modeling

Indexed keywords

ARBITRARY NUMBER; BELLCORE; COEFFICIENT OF VARIATION; COUNTING PROCESS; DATA TRACES; DESCRIPTORS; DISK DRIVE; FITTING ALGORITHMS; FITTING METHOD; FITTING TECHNIQUES; HIGHER ORDER; INTER-ARRIVAL TIME; KRONECKER PRODUCT; MARKOV MODELING; MARKOVIAN ARRIVAL PROCESS; NON-LINEAR OPTIMIZATION; NUMERICAL RESULTS; PERFORMANCE EVALUATION; PREDICTION ACCURACY; REAL TRAFFIC; SEAGATE; SECOND ORDERS; STATISTICAL PROPERTIES; TEMPORAL DEPENDENCE; TIME SERIES MODELING; TRACE DATA;

MARKOV PROCESSES; NUMERICAL METHODS; PACKET NETWORKS; TIME SERIES;

ALGORITHMS;

EID: 70549101150     PISSN: 01665316     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.peva.2009.09.003     Document Type: Article

References (43)

1. Nelson R.D. Probability, Stochastic Processes and Queueing Theory (1995), Springer-Verlag
2. Andersen A.T., and Nielsen B.F. A Markovian approach for modeling packet traffic with long-range dependence. IEEE J. Sel. Areas Commun. 16 5 (1998) 719-732
3. M. Grossglauser, J.C. Bolot, On the relevance of long-range dependence in network traffic, in: Proc. of SIGCOMM Conf., 1996, pp. 15-24
4. A.W. Berger, On the index of dispersion for counts for user demand modeling, in: ITU, Madrid, Spain, AT&T Study Group 2, Question 17/2, June 27-29, 1994
5. Ferng H.W., and Chang J.F. Connection-wise end-to-end performance analysis of queueing networks with MMPP inputs. Perf. Eval. 43 1 (2001) 39-62
6. Kang S.H., Yong H.K., Sung D.K., and Choi B.D. An application of Markovian arrival process (MAP) to modeling superposed ATM cell streams. IEEE Trans. Commun. 50 4 (2002) 633-642
7. A. Heindl, Analytic moment and correlation matching for MAP(2)s, in: Proc. of PMCCS Workshop, 2003, pp. 39-42
8. Heindl A., Mitchell K., and van de Liefvoort A. Correlation bounds for second-order MAPs with application to queueing network decomposition. Perf. Eval. 63 6 (2006) 553-577
9. Bodrog L., Heindl A., Horváth G., and Telek M. A Markovian canonical form of second-order matrix-exponential processes. European J. Oper. Res. 190 (2008) 457-477
10. Neuts M.F. Structured Stochastic Matrices of M/G/1 Type and Their Applications (1989), Marcel Dekker, New York
11. Asmussen S., Nerman O., and Olsson M. Fitting phase-type distributions via the EM algorithm. Scand. J. Statist. 23 (1996) 419-441
12. Diamond J.E., and Alfa A.S. On approximating higher-order MAPs with MAPs of order two. Queueing Syst. 34 (2000) 269-288
13. Ryden T. An EM algorithm for estimation in Markov-modulated Poisson processes. Comput. Statist. Data Anal. 21 4 (1996) 431-447
14. Heffes H., and Lucantoni D.M. A Markov modulated characterization of packetized voice and data traffic and related statistical multiplexer performance. IEEE J. Sel. Areas Commun. 4 (1986) 856-868
15. The internet traffic archive, Nov. 2005 release http://ita.ee.lbl.gov
16. Leland W.E., Taqqu M.S., Willinger W., and Wilson D.V. On the self-similar nature of Ethernet traffic. IEEE/ACM Trans. Netw. 2 1 (1994) 1-15
17. Horváth A., and Telek M. Markovian modeling of real data traffic: Heuristic phase type and MAP fitting of heavy tailed and fractal like samples. Performance Evaluation of Complex Systems: Techniques and Tools, IFIP Performance 2002. LNCS Tutorial Series vol. 2459 (2002) 405-434
18. Riedi R.H., Crouse M.S., Ribeiro V.J., and Baraniuk R.G. A multifractal wavelet model with application to network traffic. IEEE Trans. Inform. Theory 45 3 (1999) 992-1018
19. Taqqu M.S., Teverovsky V., and Willinger W. Is network traffic self-similar or multifractal?. Fractals 63 5 (1997) 833-846
20. G. Horváth, P. Buchholz, M. Telek, A MAP fitting approach with independent approximation of the inter-arrival time distribution and the lag correlation, in: Proc. of 2nd Conf. on Quantitative Evaluation of Systems, QEST, 2005, pp. 124-133
21. G. Horváth, M. Telek, A canonical representation of order 3 phase type distributions, in: LNCS 4748: Formal Methods and Stochastic Models for Performance Evaluation, 2007, pp. 48-62
22. R. Sadre, Decomposition-Based Analysis of Queueing Networks, Ph.D. Thesis, University of Twente, 2007
23. Heyman D.P., and Lucantoni D. Modeling multiple IP traffic streams with rate limits. IEEE/ACM Trans. Netw. 11 6 (2003) 948-958
24. A. Heindl, Traffic-based decomposition of general queueing networks with correlated input processes, Ph.D. Thesis, Shaker Verlag, Aachen, 2001
25. Kawanishi K. On the counting process for a class of Markovian arrival processes with an application to a queueing system. Queueing Syst. 49 2 (2005) 93-122
26. Li S., and Hwang C. Queue response to input correlation functions: Continuous spectral analysis. IEEE/ACM Trans. Netw. 1 6 (1993) 678-692
27. Hajek B., and He L. On variations of queue response for inputs with the same mean and autocorrelation function. IEEE/ACM Trans. Netw. 6 5 (1998) 588-598
28. Andersen A.T., and Nielsen B.F. On the use of second-order descriptors to predict queueing behavior of MAPs. Naval Res. Logistics 49 4 (2002) 391-409
29. Fan J., and Yao Q. Nonlinear Time Series: Nonparametric and Parametric Methods (2003), Springer-Verlag, New York, USA
30. L. Bodrog, A. Heindl, G. Horváth, M. Telek, A. Horváth, Current results and open questions on PH and MAP characterization, in: Dagstuhl Seminar Proceedings 07461, Schloss Dagstuhl, Germany 2008
31. Breuer L. An EM algorithm for batch markovian arrival processes and its comparison to a simpler estimation procedure. Ann. Oper. Res. 112 1-4 (2002) 123-138
32. Buchholz P., and Panchenko A. A two-step EM algorithm for MAP fitting. Proc. of ISCIS. LNCS Tutorial Series vol. 3280 (2004), Springer 217-227
33. Riska A., Diev V., and Smirni E. An EM-based technique for approximating long-tailed data sets with PH distributions. Perf. Eval. 55 1-2 (2004) 147-1674
34. Riska A., and Riedel E. Long-range dependence at the disk drive level. QEST 2006 Conference (2006), IEEE Press 41-50
35. G. Casale, E.Z. Zhang, E. Smirni, KPC-toolbox: Simple yet effective trace fitting using Markovian arrival processes, in: Proc. of the 5th Conf. on Quantitative Evaluation of Systems (QEST), 2008, pp. 83-92
36. Telek M., and Horváth G. A minimal representation of Markov arrival processes and a moments matching method. Perf. Eval. 64 9-12 (2007) 1153-1168
37. Hohn F.E. Elementary Linear Algebra (1973), Dover
38. Saar A. Numerical Methods for Large Eigenvalue Problems (1992), Manchester University Press
39. G. Casale, E.Z. Zhang, E. Smirni, Interarrival times characterization and fitting for Markovian traffic analysis, Technical Report WM-CS-2008-02, available at http://www.wm.edu/as/computerscience/documents/cstechreports/WM-CS-2008- 02.pdf, College of William and Mary, 2008
40. Brewer J.W. Kronecker products and matrix calculus in system theory. IEEE Trans. Circuits Sys. 25 9 (1978)
41. H. Che, S. Li, Fast algorithms for measurement-based traffic modeling, in: Proc. of INFOCOM Conf., 1997, pp. 177-186
42. Sriram K., and Whitt W. Characterizing superposition arrival processes in packet multiplexers for voice and data. IEEE J. Sel. Areas Commun. 4 6 (1986) 833-846
43. Lucantoni D.M. New results on the single server queue with a batch Markovian arrival process. Stoch. Models 7 (1991) 1-46