Automatic detection of performance deviations in the load testing of Large Scale Systems

Proceedings - International Conference on Software Engineering

Volumn , Issue , 2013, Pages 1012-1021

  Malik, Haroon ^a   Hemmati, Hadi ^b   Hassan, Ahmed E ^a  

^a QUEEN S UNIVERSITY   (Canada)

^b UNIVERSITY OF WATERLOO   (Canada)

Author keywords

Machine Learning; Performance; Signature

Indexed keywords

AUTOMATIC DETECTION; BENCHMARK APPLICATIONS; LOGISTIC REGRESSION MODELING; PERFORMANCE; PERFORMANCE COUNTERS; ROOT CAUSE ANALYSIS; SIGNATURE; UNSUPERVISED APPROACHES;

LARGE SCALE SYSTEMS; LEARNING SYSTEMS; NETWORK ARCHITECTURE; OPEN SYSTEMS; REGRESSION ANALYSIS; SOFTWARE ENGINEERING;

BENCHMARKING;

EID: 84886438382     PISSN: 02705257     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICSE.2013.6606651     Document Type: Conference Paper

References (18)

1. L. H. Lin, A. Tanyavutti and S. Jindrapacha, "Analyzing eBay platform strategies: An application of meyer's product platform strategy model," in Management of Engineering and Technology, Portland International Center for, pp. 125-142.
2. Z. M. Jiang, A. E. Hassan, G. Hamann and P. Flora, "Automated performance analysis of load tests," in IEEE International Conference on in Software Maintenance, ICSM 2009, pp. 125-134.
3. Z. M. Jiang, "Automated analysis of load testing results," in Proceedings of the 19th International Symposium on Software Testing and Analysis, Trento, Italy, 2010, pp. 143-146.
4. H. Malik, Z. M. Jiang, B. Adams, A. E. Hassan, P. Flora and G. Hamann, "Automatic comparison of load tests to support the performance analysis of large enterprise systems," in 14th European Conference on Software Maintenance and Reengineering, Madraid, Spain, 2010, pp. 222-231.
5. K. C. D. Foo. Automated discovery of performance regressions in enterprise applications. 2011. Available: http://sail. cs. queensu. ca/publications/pubs/masterthesis2011-foo. pdf
6. H. Malik, B. Adams, A. E. Hassan, P. Flora and G. Hamann, "Using load tests to automatically compare the subsystems of a large enterprise system," in IEEE Computer Software and Applications Conference, Seoul, Korea, 2010, pp. 117-126.
7. T. H. D. Nguyen, B. Adams, Z. M. Jiang and A. E. Hassan, "Automatic Load Test Verification Using Control Charts" In Proceedings of the 18th Asia Pacific Software Engineering Conference, 2011.
8. K. A. Huck and A. D. Malony, "PerfExplorer: A performance data mining framework for large-scale parallel computing," in Proceedings of the ACM/IEEE SC Supercomputing Conference, 2005, pp. 41-41.
9. I. Jolliffe, Principal Component Analysis. Springer verlag, 2002.
10. H. Malik, B. Adams and A. E. Hassan, "Pinpointing the subsystems responsible for the performance deviations in a load test," in IEEE 21st International Symposium on Software Reliability Engineering (ISSRE), San Jose, California, USA, 2010, pp. 201-210.
11. J. Leng, C. Valli and L. Armstrong, "A Wrapper-Based Feature Selection for Analysis of Large Data Sets," ECU Publications, 2010.
12. M. A. Hall and G. Holmes, "Benchmarking attribute selection techniques for discrete class data mining," IEEE Transactions on Knowledge and Data Engineering, 2003, vol. 15, pp. 1437-1447
13. A. Podgurski, D. Leon, P. Francis, W. Masri, M. Minch, J. Sun and B. Wang, "Automated support for classifying software failure reports," in Proceeding of 25th International Conference on Software Engineering, 2003, PP. 465-475.
14. S. Pertet and P. Narasimhan, "Causes of failure in web applications," Parallel Data Laboratory, Carnegie Mellon University, CMU-PDL-05-109.
15. D. Thakkar, A. E. Hassan, G. Hamann and P. Flora, "A framework for measurement based performance modeling," in Proceedings of the 7th International Workshop on Software and Performance, Princeton, NJ, USA, 2008, pp. 55-66.
16. S. R. Sandeep, M. Swapna, T. Niranjan, S. Susarla and S. Nandi, "CLUEBOX: A Performance Log Analyzer for Automated Troubleshooting," 18-2008.
17. M. Leyda and R. Geiss "WinThrottle," 2010.
18. J. McCaffrey, (Online). 2013(Mar 25th), Available: http://msdn. microsoft. com/en-us/magazine/cc163613. aspx