Supporting swift reaction: Automatically uncovering performance problems by systematic experiments

Proceedings - International Conference on Software Engineering

Volumn , Issue , 2013, Pages 552-561

  Wert, Alexander ^a   Happe, Jens ^b   Happe, Lucia ^a  

^a KARLSRUHE INSTITUTE OF TECHNOLOGY   (Germany)

^b SAP RESEARCH   (Germany)

Author keywords

measurement; performance; problem detection

Indexed keywords

BENCHMARK IMPLEMENTATION; DEPLOYMENT SCENARIOS; MAXIMUM THROUGH-PUT; PERFORMANCE; PERFORMANCE PROBLEMS; PROBLEM DETECTION; SOFTWARE PERFORMANCE ENGINEERINGS; SYSTEMATIC EXPERIMENT;

APPLICATION PROGRAMS; MEASUREMENTS; SOFTWARE ENGINEERING;

BENCHMARKING;

EID: 84886418892     PISSN: 02705257     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICSE.2013.6606601     Document Type: Conference Paper

References (36)

1. C. Smith, "Software performance engineering," Performance Evaluation of Computer and Communication Systems, pp. 509-536, 1993.
2. B. W. Boehm, Software Engineering Economics, ser. Prentice-Hall Advances in Computing Science & Technology Series. Englewood Cliffs, NJ: Prentice-Hall, 1981.
3. -, "Software engineering economics," Software Engineering, IEEE Transactions on, vol. SE-10, no. 1, pp. 4-21, jan. 1984.
4. J. Stecklein, "Error cost escalation through the project life cycle," http://ntrs.nasa.gov/archive/nasa/casi.ntrs.nasa.gov/20100036670 2010039922.pdf, NASA, Tech. Rep., 2004.
5. V. Cortellessa, A. Di Marco, R. Eramo, A. Pierantonio, and C. Trubiani, "Digging into uml models to remove performance antipatterns," in Proc. ICSE. ACM, 2010, pp. 9-16.
6. C. Trubiani and A. Koziolek, "Detection and solution of software performance antipatterns in palladio architectural models," in Proc. ICPE. ACM, 2011, pp. 19-30.
7. Z. Jiang, A. Hassan, G. Hamann, and P. Flora, "Automated performance analysis of load tests," in Proc. ICSM. IEEE, 2009, pp. 125-134.
8. M. Grechanik, C. Fu, and Q. Xie, "Automatically finding performance problems with feedback-directed learning software testing," in Proc. ICSE, 2012.
9. A. Avritzer and E. Weyuker, "The automatic generation of load test suites and the assessment of the resulting software," Software Engineering, IEEE Transactions on, vol. 21, no. 9, pp. 705-716, 1995.
10. V. Garousi, L. Briand, and Y. Labiche, "Traffic-aware stress testing of distributed systems based on uml models," in Proc. ICSE. ACM, 2006, pp. 391-400.
11. T. Parsons and J. Murphy, "A framework for automatically detecting and assessing performance antipatterns in component based systems using run-time analysis," in Proc. WCOP, 2004.
12. B. Miller, M. Callaghan, J. Cargille, J. Hollingsworth, R. Irvin, K. Karavanic, K. Kunchithapadam, and T. Newhall, "The paradyn parallel performance measurement tool," Computer, vol. 28, pp. 37-46, 1995.
13. C. Smith and L. Williams, "New software performance antipatterns: More ways to shoot yourself in the foot," in CMG-CONFERENCE-, vol. 2, 2003, pp. 667-674.
14. -, "Software performance antipatterns," in Proc. WOSP. ACM, 2000, pp. 127-136.
15. -, "More new software performance antipatterns: Even more ways to shoot yourself in the foot," in CMG-CONFERENCE-, 2003, pp. 717-725.
16. -, "Software performance antipatterns; common performance problems and their solutions," in CMG-CONFERENCE-, vol. 2, 2002, pp. 797-806.
17. R. Dugan Jr, E. Glinert, and A. Shokoufandeh, "The sisyphus database retrieval software performance antipattern," in Proc. WOSP. ACM, 2002, pp. 10-16.
18. B. Dudney, S. Asbury, J. Krozak, and K. Wittkopf, J2EE antipatterns. Wiley, 2003.
19. "Object web homepage: Java implementation of the tpc-w benchmark," last visited: July 2012. http://jmob.ow2.org/tpcw.html.
20. A. Wert, "Uncovering performance antipatterns by systematic experiments," Master's thesis, Karlsruhe Institute of Technology, 2012.
21. D. Rayside and L. Mendel, "Object ownership profiling: a technique for finding and fixing memory leaks," in Proc. ASE. ACM, 2007, pp. 194-203.
22. J. Swets, "Measuring the accuracy of diagnostic systems," Science, vol. 240, no. 4857, pp. 1285-1293, 1988.
23. M. Hsueh, T. Tsai, and R. Iyer, "Fault injection techniques and tools," Computer, vol. 30, no. 4, pp. 75-82, 1997.
24. D. Menascé, "Tpc-w: A benchmark for e-commerce," Internet Computing, IEEE, vol. 6, no. 3, pp. 83-87, 2002.
25. "Javassist web homepage," last visited: January 2013. http://www.csg.is.titech.ac.jp/chiba/javassist.
26. "Homepage of BoneCP," http://jolbox.com/, last visited: August 2012.
27. "HP LoadRunner," http://www8.hp.com/us/en/software-solutions/ softwa re.html?compURI=1175451#.UP0NO3d71Iw, last visited: Januar 2013.
28. J. Xu, "Rule-based automatic software performance diagnosis and improvement," in Proc. WOSP. ACM, 2008, pp. 1-12.
29. A. Avritzer and B. Larson, "Load testing software using deterministic state testing," in ACM SIGSOFT Software Engineering Notes, vol. 18, no. 3. ACM, 1993, pp. 82-88.
30. A. Avritzer and E. Weyuker, "Generating test suites for software load testing," in Proc. ISSTA. ACM, 1994, pp. 44-57.
31. L. Bulej, T. Kalibera, and P. Tuma, "Repeated results analysis for middleware regression benchmarking," Performance Evaluation, vol. 60, no. 1, pp. 345-358, 2005.
32. K. Foo, Z. Jiang, B. Adams, A. Hassan, Y. Zou, and P. Flora, "Mining performance regression testing repositories for automated performance analysis," in Proc. QSIC. IEEE, 2010, pp. 32-41.
33. D. Yan, G. Xu, and A. Rountev, "Uncovering performance problems in java applications with reference propagation profiling," in Proc. ICSE, 2012.
34. M. Chen, E. Kiciman, E. Fratkin, A. Fox, and E. Brewer, "Pinpoint: Problem determination in large, dynamic internet services," in Proc. DSN. IEEE, 2002, pp. 595-604.
35. J. Ehlers, A. van Hoorn, J. Waller, and W. Hasselbring, "Self-adaptive software system monitoring for performance anomaly localization," in Proc. ICAC. ACM, 2011, pp. 197-200.
36. B. Miller and A. Mirgorodskiy, "Diagnosing distributed systems with self-propelled instrumentation," IFIP Lecture Notes in Computer Science (LNCS), vol. 5346, no. 5346, pp. 82-103, 2012.