A hierarchical framework for modeling and forecasting web server workload

Journal of the American Statistical Association

Volumn 100, Issue 471, 2005, Pages 748-763

  Li, Ta Hsin ^a  

^a IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

Adaptive; Autoregressive; Computer network; Filterbank; Heavy tail; Heteroscedasticity; Non Gaussian; Nonstationary; Seasonal time series; Utility computing; Web traffic

Indexed keywords

EID: 24644508465     PISSN: 01621459     EISSN: None     Source Type: Journal    
DOI: 10.1198/016214505000000565     Document Type: Review

References (43)

1. Bhansali, R. J. (1996), "Asymptotically Efficient Autoregressive Model Selection for Multi-Step Prediction," Annals of the Institute of Statistical Mathematics, 48, 577-602.
2. Bolot, J.-C., and Hoschka, P. (1996), "Performance Engineering of the World Wide Web: Application to Dimensioning and Cache Design," Computer Networks and ISDN Systems, 28, 1397-1405.
3. Brockwell, P. J., and Davis, R. A. (1991), Time Series: Theory and Methods (2nd ed.), New York: Springer-Verlag.
4. Chandra, A., Gong, W., and Shenoy, P. (2003), "Dynamic Resource Allocation for Shared Data Centers Using Online Measurements," Proceedings of the ACM Joint International Conference on Measurement and Modeling of Computer Systems (SIGMETRICS), 31, 300-301.
5. Chandra, K., and Eckberg, A. E. (1997), "Traffic Characteristics of On-Line Services," in Proceedings of the Second IEEE Symposium on Computers and Communications, Washington, DC: IEEE Computer Society, pp. 17-21.
6. Chen, Y.-W. (2002), "Traffic Behavior Analysis and Modeling of Sub-Networks," International Journal of Network Management, 12, 323-330.
7. Cox, D. R. (1961), "Prediction by Exponentially Weighted Moving Averages and Related Methods," Journal of the Royal Statistical Society, Ser. B, 23, 414-422.
8. Crovella, M. E., and Bestavros, A. (1997), "Self-Similarity in World Wide Web Traffic: Evidence and Possible Causes," IEEE/ACM Transactions on Networking, 5, 835-846.
9. Douglas, A. P., Breipohl, A. M., Lee, F. N., and Adapa, R. (1998), "Risk Due to Load Forecasting Uncertainty in Short-Term Power System Planning," IEEE Transactions on Power Systems, 13, 1493-1499.
10. Doyle, R. P., Chase, J. S., Asad, O. M., Jen, W., and Vahdat, A. M. (2003), "Model-Based Resource Provisioning in a Web Service Utility," in Proceedings of the USENIX Symposium on Internet Technologies and Systems, Seattle, WA: USENIX Association, pp. 54-71.
11. Findley, D. F. (1984), "On Some Ambiguities Associated With the Fitting of ARMA Models to Time Series," Journal of Time Series Analysis, 5, 217-227.
12. Franses, P. H. (1998), Time Series Models for Business and Economic Forecasting, Cambridge, U.K.: Cambridge University Press.
13. Friedman, J. H. (1984), "A Variable Span Scatterplot Smoother," Technical Report 5, Stanford University, Laboratory for Computational Statistics.
14. Gallardo, J. R., Makrakis, D., and Angulo, M. (2001), "Dynamic Resource Management Considering the Real Behavior of Aggregate Traffic," IEEE Transactions on Multimedia, 3, 177-185.
15. Gersch, W., and Kitagawa, G. (1983), "The Prediction of Time Series With Trends and Seasonalities," Journal of Business & Economic Statistics, 1, 253-264.
16. Gross, G., and Galiana, F. D. (1987), "Short-Term Load Forecasting," Proceedings of the IEEE, 15, 1558-1573.
17. Hart, J. D. (1997), Nonparametric Smoothing and Lack-of-Fit Tests, New York: Springer-Verlag.
18. Harvey, A. C. (1993), Time Series Models (2nd ed.), Cambridge, MA: MIT Press.
19. Hasegawa, M., Wu, G., and Mizuno, M. (2001), "Applications of Nonlinear Prediction Methods to the Internet Traffic," Proceedings of the IEEE International Symposium on Circuits and Systems, 3, 169-172.
20. Haykin, S. (1996), Adaptive Filter Theory (3rd ed.), Upper Saddle River, NJ: Prentice-Hall.
21. Haywood, J., and Wilson, G. T. (1997), "Fitting Time Series Models by Minimizing Multistep-Ahead Errors: A Frequency Domain Approach," Journal of the Royal Statistical Society, Ser. B, 59, 237-254.
22. Hellerstein, J. L., Zhang, F., and Shahabuddin, P. (1999), "An Approach to Predictive Detection for Service Management," in Proceedings of the 6th IFIP/IEEE International Symposium on Integrated Network Management, Washington, DC: IEEE Press, pp. 309-322.
23. Hinich, M. J. (2000), "A Statistical Theory of Signal Coherence," IEEE Journal of Ocean Engineering, 25, 256-261.
24. Kant, K., and Won, Y. (1999), "Server Capacity Planning for Web Traffic Workload," IEEE Transactions on Knowledge and Data Engineering, 11, 731-747.
25. Li, T. H. (2002), "On Exponentially Weighted Recursive Least Squares for Estimating Time-Varying Parameters," IBM Research Report RC22857.
26. Li, T. H., and Hinich, M. J. (2002), "A Filter Bank Approach for Modeling and Forecasting Seasonal Patterns," Technometrics, 44, 1-14.
27. Lütkepohl, H. (1993), Introduction to Multiple Time Series Analysis (2nd ed.), New York: Springer-Verlag.
28. Moghram, I., and Rahman, S. (1989), "Analysis and Evaluation of Five Short-Term Load Forecasting Techniques," IEEE Transactions on Power Systems, 4, 1484-1491.
29. Montgomery, D. C., and Peck, E. A. (1992), Introduction to Linear Regression Analysis, New York: Wiley.
30. Nogales, F. J., Contreras, J., Conejo, A. J., and Espinola, R. (2002), "Forecasting Next-Day Electricity Prices by Time Series Models," IEEE Transactions on Power Systems, 17, 342-348.
31. Park, J. H., Park, Y. M., and Lee, K. Y. (1991), "Composite Modeling for Adaptive Short-Term Load Forecasting," IEEE Transactions on Power Systems, 6, 450-457.
32. Pazel, D. P., Eilam, T., Fong, L. L., Kalantar, M., Appleby, K., and Goldszmidt, G. (2002), "Neptune: A Dynamic Resource Allocation and Planning System for a Cluster Computing Utility," in Proceedings of the 2nd IEEE/ACM International Symposium on Cluster Computing and the Grid, Washington, DC: IEEE Computer Society, pp. 48-55.
33. Ramanathan, R., Engle, R., Granger, C. W. J., Vahid-Araghi, F., and Brace, C. (1997), "Short-Run Forecasts of Electricity Loads and Peaks," International Journal of Forecasting, 13, 161-174.
34. Sargunaraj, S., Sen Gupta, D. P., and Devi, S. (1997), "Short-Term Load Forecasting for Demand Side Management," IEE Proceedings on Generation, Transmission, and Distribution, 144, 68-74.
35. Shen, D., and Hellerstein, J. L. (2000), "Predictive Models for Proactive Network Management: Application to a Production Web Werver," in 2000 IEEE/IFIP Network Operations and Management Symposium, Honolulu, Hawaii: IEEE Publishing, pp. 833-846.
36. Shibata, R. (1980), "Asymptotically Efficient Selection of the Order of the Model for Estimating Parameters of a Linear Process," The Annals of Statistics, 8, 147-164.
37. Squillante, M., Yao, D. D., and Zhang, L. (1999), "Web Traffic Modeling and Web Server Performance Analysis," in Proceedings of the 38th Conference on Decision and Control, Phoemix, AZ: IEEE Press, pp. 4432-4439.
38. Stoica, P., and Nehorai, A. (1989), "On Multi-Step Prediction Error Methods for Time Series Models," Journal of Forecasting, 8, 357-368.
39. Tiao, G. C., and Xu, T. (1993), "Robustness of Maximum Likelihood Estimates for Multi-Step Predictions: The Exponential Smoothing Case," Biometrika, 80, 623-641.
40. Weiss, A. A. (1991), "Multi-Step Estimation and Forecasting in Dynamic Models," Journal of Econometrics, 48, 135-149.
41. Wu, M., Joyce, R. A., Wong, H.-S., and Kung, S.-Y (2001), "Dynamic Resource Allocation via Video Content and Short-Term Traffic Statistics," IEEE Transactions on Multimedia, 3, 186-199.
42. You, C., and Chandra, K. (1999), "Time Series Models for Internet Data Traffic," in Proceedings of the 24th Conference on Local Computer Networks, Lowell, MA: IEEE Press, pp. 164-171.
43. Young, P. C., Pedregal, D. J., and Tych, W. (1999), "Dynamic Harmonic Regression," Journal of Forecasting, 18, 369-394.