Exploiting nonstationarity for performance prediction

Operating Systems Review (ACM)

Volumn , Issue , 2007, Pages 31-44

  Stewart, Christopher ^a   Kelly, Terence ^b   Zhang, Alex ^b  

^a UNIVERSITY OF ROCHESTER   (United States)

^b HEWLETT PACKARD LABORATORIES   (United States)

Author keywords

Enterprise; Internet services; LAR regression; Mutli tier; Noninvasive; Nonstationarity; Performance prediction; Realistic workloads

Indexed keywords

ADMINISTRATIVE DATA PROCESSING; BENCHMARKING; DATA STRUCTURES; FUNCTION EVALUATION; INFORMATION SERVICES; INTERNET; REAL TIME SYSTEMS; CALIBRATION; DECISION SUPPORT SYSTEMS;

APPLICATION-LEVEL PERFORMANCE; INTERNET SERVICES; LAR REGRESSION; NONINVASIVES; NONSTATIONARITY; PERFORMANCE PREDICTION; REALISTIC WORKLOADS;

ELECTRONIC COMMERCE; FORECASTING;

APPLICATION-LEVEL PERFORMANCE; CRITICAL PRODUCTION; DECISION SUPPORTS; E-COMMERCE SITES; ENTERPRISE APPLICATIONS; INTERNET SERVICES; MODEL CALIBRATION; NEW APPROACHES; NON-STATIONARITIES; NONSTATIONARY; PASSIVE MEASUREMENTS; PERFORMANCE PREDICTION; PREDICTION METHODS; PREDICTIVE ACCURACY; PRODUCTION ENVIRONMENTS; RELATIVE FREQUENCIES; RESOURCE UTILIZATIONS; RESPONSE TIME;

EID: 34548020557     PISSN: 01635980     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1272996.1273002     Document Type: Conference Paper

References (52)

1. A. Andrzejak, M. Arlitt, and J. A. Rolia. Bounding the resource savings of utility computing models. Technical. Report. HPL-2002-339, HP Labs, Dec. 2002.
2. M. Arlitt. Characterizing Web user sessions. Performance Evaluation Review, 28(2), Sept. 2000.
3. M. Arlitt, D. Krishnamurthy, and J. A. Rolia. Characterizing the scalability of a large web-based shopping system. ACM Trans. on Internet Tech, 1(1):44-69, Aug. 2001.
4. M. Arlitt and C. Williamson. Web server workload characterization: The search, for invariants. In SIGMETRICS, May 1996.
5. M. F. Arlitt and C. L. Williamson. Internet Web servers: Workload characterization and performance implications. IEEE/ACM Trans. on Networking, 5(5):631-644, Oct. 1997.
6. H. P. Artis. Capacity planning for MVS computer systems. Performance Evaluation Review, 8(4):45-62, 1979.
7. P. Barham, A. Donnelly, R. Isaacs, and R. Mortier. Using Magpie for request extraction and workload modelling. In OSDI, pages 259-272, Dec. 2004.
8. I. Barrodale and F. Roberts. An improved algorithm for discrete L1 linear approximations. SIAM Journal of Numerical Analysis, 10:839-848, 1973.
9. F. Baskett, K. M. Chandy, R. R. Muntz, and F. G. Palacios. Open, closed, and mixed networks of queues with different classes of customers. IACM, 22(2):248-260, Apr. 1975.
10. G. Bolen, S. Greiner, H. de Meer, and K. S. Trivedi. Queueing Networks and Markov Chains. Wiley, 1998.
11. L. Breslau, P. Cao, L. Fan, G. Phillips, and S. Shenker. Web caching and Zipf-like distributions: Evidence and implications. In INFOCOM, Mar. 1999.
12. J. Cao, W S. Cleveland, D. Lin, and D. X. Sun. On the nonstationarity of Internet traffic. In SIGMETRICS, pages 102-112, June 2001.
13. G. Casale. An efficient algorithm for the exact analysis of multiclass queueing networks with large population sizes. In SIGMETRICS, pages 169-180, June 2006.
14. A. Cockcroft and B. Walker. Capacity Planning for Internet Services. Sun Press, 2001.
15. I. Cohen, M. Goldszmidt, T. Kelly, J. Symons, and J. S. Chase. Correlating instrumentation data to system, states: A building block for automated diagnosis and control. In OSDI, Oct. 2004.
16. I. Cohen, S. Zhang, M. Goldszmidt, J. Symons, T. Kelly, and A. Fox. Capturing, indexing, clustering, and retrieving system, history. In SOSP, Oct. 2005.
17. P. J. Denning and J. P. Buzen. The operational analysis of queueing network models. ACM Computing Surveys, 10(3):225-261, Sept. 1978.
18. A. Esposito, A. Mazzeo, and P. Costa. Workload characterization for trend analysis. Performance Evaluation Review, 10(2), July 1981.
19. Hewlett-Packard. Open View Transaction Analyzer, Sept 2006. http://h20229.www2.hp.com/products/tran/.
20. R. Jain. The Art of Computer Systems Performance Analysis. John Wiley & Sons, 1991.
21. The JBoss J2EEApplication Server, http://www.jboss.com.
22. J. Jung, B. Krishnamurthy, and M. Rabinovich. Flash crowds and denial of service attacks: characterization and implications for CDNs and Web sites. In WWW, May 2002.
23. T. Kelly. Detecting performance anomalies in global applications. In USENIX WORLDS, Dec. 2005.
24. T. Kelly and A. Zhang. Predicting performance in distributed enterprise applications. Technical Report. HPL-2006-76, HP Labs, May 2006. http://www.hpl.hp.com/techreports/2006/HPL-2006-76.html.
25. D. Krishnamurthy, J. A. Rolia, and S. Majumdar. SWAT: A tool for stress testing session-based Web applications. In Computer Measurement Group Conf., Dec. 2003.
26. D. Krishnamurthy, J. A. Rolia, and S. Majumdar. A synthetic workload generation, technique for stress testing session-based systems. IEEE Trans. Software Engineering, 32(11):868-882, Nov. 2006.
27. J. R. Laras. Whole program paths. In PLDI, May 1999.
28. X. Liu, J. Heo, and L. Sha. Modeling 3-tiered web applications. In Proc. MASCOTS, Sept. 2005. http://www.cs.mcgill.ca/xueliu/publications/ MASCOTS05.Modeling.pdf.
29. D. Menasce, V. Almeida, R. Riedi, F. Ribeiro, R. Fonseca, and W. Meira. In search of invariants for e-business workloads. In ACM E-Commerce Conf., Oct. 2000.
30. D. A. Menasce, V. A. F. Almeida, R. Fonseca, and M. A. Mendes. A methodology for workload characterization of e-commerce sites. In ACM E-Commerce Conf., Nov. 1999.
31. Mercury Interactive. Loadranner load tester, Sept. 2006. http://www.mercury.com/us/products/performance-center/loadrunner/.
32. MySQL database, http://www.mysql.com.
33. J. Neter, M. H. Kutner, C. J. Nachtsheim, and W. Wasserman. Applied Linear Statistical Models. Irwin, fourth edition, 1996.
34. C. R. Rao and H. Toutenburg. Linear Models: Least Squares and Alternatives. Springer, 1999.
35. M. Reiser and S. Lavenberg. Mean value analysis of closed multichain queuing networks. J. ACM, 27(2):313-322, Apr. 1980.
36. J. A. Rolia and K. C. Sevcik. The method of layers. IEEE Trans. Software Engineering, 21(8):689-700, Aug. 1995.
37. J. A. Rolia, X. Zhu, and M. Arlitt. Resource access management for a resource utility for commercial, applications. In Int'l Sympos. on Integrated Network Mgmt. (IM), Mar. 2003.
38. Rice University Bidding System (RUBiS), Mar. 2004. http://rubis. objectweb.org/.
39. R. F. Sauers, C. P. Ruemmier, and P. S. Weygant. HP-UX 11i Tuning and Performance. Prentice Hall, 2004.
40. B. Schroeder, A. Wierman, and M. Harchol-Balter. Open versus closed: A cautionary tale. In NSDI, pages 239-252, May 2006.
41. C. Stewart and K. Shen. Performance modeling and system management for multi-component online services. In NSDI, pages 71-84, May 2005.
42. The StockOnline Benchmark, http://forge.objectweb.org/projects/stock- online.
43. D. W Stroock. An Introduction to Markov Processes. Springer, May 2005.
44. R. Talaber. Server consolidation assessments with VMware CapacityPlanner, Oct. 2005. http://download3.vmware.com/vmworld/2005/pac196.pdf.
45. The Open Group. Application response measurement (ARM), Sept. 2006. http://www.opengroup.org/management/arm.
46. E. Thereska, B. Salmon, J. Strunk, M. Wachs, M. Abd-El-Malek, J. Lopez, and G. R. Ganger. Stardust: Tracking activity in a distributed storage system. In Proc. SIGMETRICS, pages 3-14, June 2006.
47. Transaction Processing Performance Council. TPC-W benchmark, Apr. 2005. http://www.tpc.org/tpcw/.
48. B. Urgaonkar, G. Pacifici, P. Shenoy, M. Spreitzer, and A. Tantawi. An analytical model for multi-tier Internet services and its applications. In SIGMETRICS, pages 291-302, June 2005.
49. B. Urgaonkar, P. Shenoy, and T. Roscoe. Resource overbooking and application profiling in shared hosting platforms. In OSDI, Dec. 2002.
50. VMWare. Server capacity planning and consolidation, Oct. 2005. http://www.vmware.com/news/releases/vac.services.html.
51. Q. Wang, D. J. Makaroff, and H. K. Edwards. Characterizing customer groups for an e-commerce website. In ACM E-Commerce Conf., May 2004.
52. R. R. Wilcox. Introduction to Robust Estimation and Hypothesis Testing. Elsevier, second edition, 2005.