Hierarchical forecasting of web server workload using sequential Monte Carlo training

IEEE Transactions on Signal Processing

Volumn 55, Issue 4, 2007, Pages 1286-1297

  Vercauteren, Tom ^a   Aggarwal, Pradeep ^b   Wang, Xiaodong ^b   Li, Ta Hsin ^c  

^a INRIA   (France)

^b Columbia University ^*  (United States)

^c IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

Dynamic harmonic regression; Seasonal time series; Sequential Monte Carlo; Web load prediction

Indexed keywords

COMPUTER SIMULATION; INTERNET; MONTE CARLO METHODS; QUALITY OF SERVICE; SERVERS; WEBSITES;

AUTOREGRESSIVE MODEL; DYNAMIC HARMONIC REGRESSION; SEQUENTIAL MONTE CARLO; WEB SERVER;

WEB SERVICES;

EID: 34147143334     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSP.2006.889401     Document Type: Article

References (29)

1. V. A. F. Almeida and D. A. Menasce, Capacity Planning for Web Services: Metrics, Models, and Methods. Englewood Cliffs, NJ: Prentice-Hall, 2002.
2. A. Chandra, W. Gong, and P. Shenoy, "Dynamic resource allocation for shared data centers using online measurements," in Proc. 2003 ACM Joint Int. Conf. Measurement Modeling of Computer Systems (SIG-METRICS'03), Jun. 2003, vol. 31, pp. 300-301.
3. R. P. Doyle, J. S. Chase, O. M. Asad, W. Jen, and A. M. Vahdat, "Model-based resource provisioning in a Web service utility," in Proc. 2003 USENIX Symp. Internet Technologies Systems, Seattle, WA, Mar. 26-28, 2003.
4. D. P. De Farias, A. King, M. Squillante, and B. Van Roy, "Dynamic control of Web server farms," in Proc. 2002 INFORMS Revenue Management Section Conf., New York, Jun. 13-14, 2002.
5. D. P. Pazel, T. Eilam, L. L. Fong, M. Kalantar, K. Appleby, and G. Goldszmidt, "Neptune: A dynamic resource allocation and planning system for a cluster computing utility," in Proc. 2002 IEEE/ACM Int. Symp. Cluster Computing Grid, May 2002, pp. 48-55.
6. M. E. Crovella and A. Bestavros, "Self-similarity in world wide Web traffic: Evidence and possible causes," in Proc. 2002 IEEE/ACM Int. Symp. Cluster Computing Grid, Dec. 1997, vol. 5, pp. 835-846.
7. J. R. Gallardo, D. Makrakis, and M. Angulo, "Dynamic resource management considering the real behavior of the aggregate traffic," IEEE Trans. Multimedia, vol. 3, no. 2, pp. 177-185, June 2001.
8. K. Kant and Y. Won, "Server capacity planning for Web traffic workload," IEEE Trans. Knowl. Data Eng., vol. 11, no. 5, pp. 731-747, 1999.
9. M. Arlitt and C. L. Williamson, "Internet Web servers: Workload characterization and performance implications," IEEE Trans. Netw. vol. 5, no. 5, pp. 631-645, 1997.
10. M. S. Squillante, D. D. Yao, and L. Zhang, "Web traffic modelling and Web server performance analysis," in Proc. 1999 Conf. Decision Control, Dec. 1999, pp. 4432-4439.
11. D. Shen and J. L. Hellerstein, "Predictive models for proactive network management: Application to a production Web server," in Proc. 2000 IEEE/IFIP Network Operations Management Symp., Apr. 2000, pp. 833-846.
12. T. H. Li, "A hierarchical framework for modeling and forecasting Web server workload," J. Amer. Stat. Assoc., vol. 100, no. 471, pp. 748-763, Sep. 2005.
13. P. C. Young, D. J. Pedregal, and W. Tych, "Dynamic harmonic regression," J. Forecast., vol. 18, pp. 369-394, 1999.
14. T. H. Li and M. J. Hinich, "A filter bank approach for modeling and forecasting seasonal patterns," Technometrics, vol. 44, no. 1, pp. 1-14, 2002.
15. R. Chen and J. S. Liu, "Sequential Monte Carlo methods for dynamic systems," J. Amer. Stat. Assoc., vol. 93, pp. 1302-1044, 1998.
16. X. Wang, R. Chen, and J. S. Liu, "Monte Carlo Bayesian signal processing for wireless communications," J. VLSI Signal Process., vol. 30, no. 1-3, pp. 89-105, Jan.-Feb.-Mar. 2002.
17. R. Chen, X. Wang, and J. S. Liu, "Adaptive joint detection and decoding in flat-fading channels via mixture Kalman filtering," IEEE Trans. Inf. Theory, vol. 46, no. 6, pp. 2079-2094, Sep. 2000.
18. C. Andrieu, M. Davy, and A. Doucet, "Efficient particle filtering for jump Markov systems - Applications to time-varying autoregressions," IEEE Trans. Signal Process., vol. 51, no. 7, pp. 1762-1770, Jul. 2003.
19. A. C. Harvey, Time Series Models, 4th ed. New York: Harvester Wheatsheaf, 1993.
20. G. Gross and F. D. Galiana, "Short-term load forecasting," IEEE Proc., vol. 75, no. 12, pp. 1558-1573, Dec. 1987.
21. I. Moghram and S. Rahman, "Analysis and evaluation of five short-term load forecasting techniques," IEEE Trans. Power Sys., vol. 4, no. 4, pp. 1484-1491, Oct. 1987.
22. F. J. Nogales, J. Contreras, A. J. Conejo, and R. Espinola, "Forecasting next-day electricity prices by time-series models," IEEE Trans. Power Sys., vol. 17, no. 2, pp. 342-348, May 2002.
23. D. C. Montgomery and E. A. Peck, Introduction to Linear Regression Analysis. New York: Wiley, 1992.
24. D. Guo, X. Wang, and R. Chen, "Wavelet-based sequential Monte Carlo blind receivers in fading channels with unknown channel statistics," IEEE Trans. Signal Process., vol. 52, no. 1, pp. 227-239, Jan. 2004.
25. A. Doucet, S. J. Godsill, and C. Andrieu, "On sequential Monte Carlo sampling methods for Bayesian filtering," Stat. Comp., vol. 10, no. 3, pp. 197-208, 2000.
26. A. Doucet and C. Andrieu, "Iterative algorithms for state estimation of jump Markov linear systems," IEEE Trans. Signal Process., vol. 49, no. 6, pp. 1216-1227, Jun. 2001.
27. R. Chen and J. S. Liu, "Mixture Kalman filters," J. Amer. Stat. Assoc. (B), vol. 62, pp. 493-509, 2000.
28. R. Prado, G. Huerta, and M. West, "Bayesian time-varying autoregressions: Theory, methods and applications," J. Inst. Math. Statist. Univ. Sao Paolo, no. 4, pp. 405-422, 2000.
29. R. Prado and G. Huerta, "Time-varying autoregression with model order uncertainty," J. Time Series Anal., vol. 23, no. 5, pp. 599-618, 2002.