DEC: Service demand estimation with confidence

IEEE Transactions on Software Engineering

Volumn 38, Issue 3, 2012, Pages 561-578

  Kalbasi, Amir ^a   Krishnamurthy, Diwakar ^a   Rolia, Jerry ^b   Dawson, Stephen ^c  

^a UNIVERSITY OF CALGARY   (Canada)

^b HEWLETT PACKARD LABORATORIES   (United Kingdom)

^c SAP (UK) Limited   (United Kingdom)

Author keywords

Benchmarking; resource demand prediction; statistical regression

Indexed keywords

AGGREGATE RESOURCES; CAPACITY PLANNING; CONFIDENCE INTERVAL PREDICTION; DEMAND ESTIMATION; DIFFERENT SERVICES; MEASUREMENT-BASED; MULTI-TIER SYSTEM; MULTICOLLINEARITY; RESOURCE DEMANDS; SERVICE DEMAND; SERVICE ORIENTED; STATISTICAL REGRESSION; SUPPORT SYSTEMS; VALIDATION TEST;

BENCHMARKING; FORECASTING; REGRESSION ANALYSIS;

ESTIMATION;

EID: 84861869797     PISSN: 00985589     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSE.2011.23     Document Type: Article

References (33)

1. Amazon Elastic Compute Cloud (Amazon EC2), http://aws. amazon.com/ec2/, 2011.
2. C. Amza, A. Chanda, A.L. Cox, S. Elnikety, R. Gil, K. Rajamani, W. Zwaenepoel, E. Cecchet, and J. Marguerite, "Specification and Implementation of Dynamic Web Site Benchmarks," Proc. Fifth IEEE Workshop Workload Characterization, pp. 3-13, Nov. 2002.
3. Y. Bard and M. Shatzoff, "Statistical Methods in Computer Performance Analysis," Current Trends in Programming Methodology, vol. 3, pp. 1-51, Prentice-Hall, 1978.
4. G. Casale, E.Z. Zhang, and E. Smirni, "Kpc-Toolbox: Simple Yet Effective Trace Fitting Using Markovian Arrival Processes," Proc. Fifth Conf. Quantitative Evaluation of Systems, pp. 183-187, Sept. 2008.
5. Y. Dodge and J. Jureckova, Adaptive Regression. Springer, 2000.
6. N.R. Draper and H. Smith, Applied Regression Analysis. John Wiley &Sons, 1998.
7. J.J. Dujmovic, "Universal Benchmark Suites," Proc. Seventh Int'l Symp. Modeling, Analysis and Simulation of Computer and Telecomm. Systems, pp. 197-205, 1999.
8. Eng. Statistics Handbook, http://www.itl.nist.gov/div898/handbook/, 2011.
9. R. Jain, The Art of Computer Systems Performance Analysis: Techniques for Experimental Design, Measurement, Simulation, and Modeling. John Wiley &Sons, 1991.
10. S. Kraft, S. Pacheco-Sanchez, G. Casale, and S. Dawson, "Estimating Service Resource Consumption from Response Time Measurements," Proc. Fourth Int'l Conf. Performance Evaluation Methodologies and Tools, Oct. 2009.
11. D. Krishnamurthy, "Synthetic Workload Generation for Stress Testing Session-Based Systems," PhD thesis, Dept. of Systems and Computer Eng., Carleton Univ., 2004.
12. D. Krishnamurthy, J.A. Rolia, and S. Majumdar, "A Synthetic Workload Generation Technique for Stress Testing Session-Based Systems," IEEE Trans. Software Eng., vol. 32, no. 11, pp. 868-882, Nov. 2006. (Pubitemid 46437707)
13. U. Krishnaswamy and D. Scherson, "A Framework for Computer Performance Evaluation Using Benchmark Sets," IEEE Trans. Computers, vol. 49, no. 12, pp. 1325-1338, Dec. 2000.
14. T. Kubokawa and M. Srivastava, "Improved Empirical Bayes Ridge Regression Estimators under Multicollinearity," Comm. in Statistics-Theory and Methods, vol. 33, no. 8, pp. 1943-1973, Dec. 2004.
15. Y. Lu, T. Abdelzaher, C. Lu, L. Sha, and X. Liu, "Feedback Control with Queuing-Theoretic Prediction for Relative Delay Guarantees in Web Servers," Proc. IEEE Real-Time and Embedded Technology and Applications Symp., pp. 208-217, 2003.
16. D. Menasce, "Computing Missing Service Demand Parameters for Performance Models," Proc. Int'l Computer Measurement Group Conf., pp. 241-248, 2008.
17. N. Mi, Q. Zhang, A. Riska, E. Smirni, and E. Riedel, "Performance Impacts of Autocorrelated Flows in Multi-Tiered Systems," Performance Evaluation, vol. 64, nos. 9-12, pp. 1082-1101, 2007. (Pubitemid 47302134)
18. D. Mosberger and T. Jin, "httperf-A Tool for Measuring Web Server Performance," ACM SIGMETRICS Performance Evaluation Rev., vol. 26, no. 3, pp. 31-37, 1998. (Pubitemid 128605767)
19. J. Neter, M.H. Kutner, C.J. Nachtsheim, and W. Wasserman, Applied Linear Statistical Models. McGraw-Hill, 1996.
20. G. Pacifici, W. Segmuller, M. Spreitzer, and A. Tantawi, "CPU Demand for Web Serving: Measurement Analysis and Dynamic Estimation," Performance Evaluation, vol. 65, nos. 6/7, pp. 531-553, June 2008.
21. J. Rolia, A. Kalbasi, D. Krishnamurthy, and S. Dawson, "Resource Demand Modeling for Multi-Tier Services," Proc. First Joint WOSP/SIPEW Int'l Conf. Performance Eng., pp. 207-216, 2010.
22. J. Rolia and V. Vetland, "Correlating Resource Demand Information with ARM Data for Application Services," Proc. Int'l Workshop Software and Performance, pp. 219-230, 1998.
23. J. Rolia and V. Vetland, "Parameter Estimation for Performance Models of Distributed Application Systems," Proc. Centre for Advanced Studies on Collaborative Research Conf., pp. 54-63, 1995.
24. SAP Business by Design, http://www.sap.com/solutions/sme/ businessbydesign/index.epx, 2011.
25. A.J. Smola and B. Scholkopf, "A Tutorial on Support Vector Regression," Statistics and Computing, vol. 14, no. 3, pp. 199-222, Aug. 2004. (Pubitemid 39063488)
26. C. Stewart, T. Kelly, and A. Zhang, "Exploiting Nonstationarity for Performance Prediction," ACM SIGOPS Operating Systems Rev., vol. 41, no. 3, pp. 31-44, 2007. (Pubitemid 47281573)
27. X. Sun, "Estimating Resource Demands for Application Services," MSc thesis, Dept. of Systems and Computer Eng., Carleton Univ., 1999.
28. TPC-W benchmark, http://www.tpc.org/tpcw/default.asp, 2011.
29. "TPC BENCHMARK W (Web Commerce) Specification," http://www.tpc.org/tpcw/spec/tpcw-V1.8.pdf, 2011.
30. U. Vallamsetty, K. Kant, and P. Mohapatra, "Characterization of E-Commerce Traffic," Electronic Commerce Research, vol. 3, nos. 1/2, pp. 167-192, 2003.
31. M. Woodside, "The Relationship of Performance Models to Data," Proc. SPEC Int'l Workshop Performance Evaluation: Metrics, Models and Benchmarks, pp. 9-28, 2008.
32. M. Woodside, T. Zhen, and M. Litoiu, "Service System Resource Management Based on a Tracked Layered Performance Model," Proc. IEEE Int'l Conf. Autonomic Computing, pp. 175-184, 2006. (Pubitemid 46666918)
33. Q. Zhang, L. Cherkasova, N. Mi, and E. Smirni, "A Regression-Based Analytic Model for Capacity Planning of Multi-Tier Applications," Proc. Fourth IEEE Int'l Conf. Autonomic Computing, June 2007.