Automatically finding performance problems with feedback-directed learning software testing

Proceedings - International Conference on Software Engineering

Volumn , Issue , 2012, Pages 156-166

  Grechanik, Mark ^a,b   Fu, Chen ^a   Xie, Qing ^a  

^a ACCENTURE   (United States)

^b UNIVERSITY OF ILLINOIS AT CHICAGO   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BLACK BOXES; EXECUTION TRACE; INPUT DATAS; INPUT VALUES; INSURANCE COMPANIES; LEARNING SOFTWARE; OPEN-SOURCE; PERFORMANCE PROBLEMS; PERFORMANCE TESTING; RANDOM TESTING; TEST INPUTS; TESTING SYSTEMS;

INPUT OUTPUT PROGRAMS; INSURANCE; SOFTWARE ENGINEERING;

SOFTWARE TESTING;

EID: 84864193632     PISSN: 02705257     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICSE.2012.6227197     Document Type: Conference Paper

References (35)

1. I. Molyneaux, The Art of Application Performance Testing: Help for Programmers and Quality Assurance. O'Reilly Media, Inc., 2009.
2. E. J. Weyuker and F. I. Vokolos, "Experience with performance testing of software systems: Issues, an approach, and case study," IEEE Trans. Softw. Eng., vol. 26, no. 12, pp. 1147-1156, 2000.
3. Z. M. Jiang, A. E. Hassan, G. Hamann, and P. Flora, "Automated performance analysis of load tests," in ICSM, 2009, pp. 125-134.
4. A. Avritzer and E. J. Weyuker, "Generating test suites for software load testing," in ISSTA. New York, NY, USA: ACM, 1994, pp. 44-57.
5. IEEE, IEEE Standard Computer Dictionary: A Compilation of IEEE Standard Computer Glossaries. Institute of Electrical and Electronics Engineers, January 1991.
6. P. Zhang, S. G. Elbaum, and M. B. Dwyer, "Automatic generation of load tests," in ASE, 2011, pp. 43-52.
7. P. Ammann and J. Offutt, Introduction to Software Testing. New York, NY, USA: Cambridge University Press, 2008.
8. K. Beck, Test-Driven Development: By Example, ser. The Addison-Wesley Signature Series. Addison-Wesley, 2003.
9. D. R. Faught, "Exploratory load testing," stickyminds.com, 2011. [Online]. Available: www.stickyminds.com/s.asp?F=S10144-COL-2
10. J. Bach, "What is exploratory testing?" stickyminds.com, 2011. [Online]. Available: www.stickyminds.com/r.asp?F=DART-2255
11. M. K. Aguilera, J. C. Mogul, J. L. Wiener, P. Reynolds, and A. Muthitacharoen, "Performance debugging for distributed systems of black boxes," in SOSP, 2003, pp. 74-89.
12. G. Ammons, J.-D. Choi, M. Gupta, and N. Swamy, "Finding and removing performance bottlenecks in large systems," in ECOOP, 2004, pp. 170-194.
13. W. Cornelissen, A. Klaassen, A. Matsinger, and G. van Wee, "How to make intuitive testing more systematic," IEEE Softw., vol. 12, no. 5, pp. 87-89, 1995.
14. C. Kaner, "What is a good test case?" in Software Testing Analysis & Review Conference (STAR) East. STAR, 2003.
15. G. J. Myers, Art of Software Testing. New York, NY, USA: John Wiley & Sons, Inc., 1979.
16. M. Grindal, J. Offutt, and S. F. Andler, "Combination testing strategies: A survey," Software Testing, Verification, and Reliability, vol. 15, pp. 167-199, 2005.
17. E. Dustin, J. Rashka, and J. Paul, Automated Software Testing: Introduction, Management, and Performance. Addison-Wesley, Sep 2004.
18. M. Fewster and D. Graham, Software Test Automation: Effective Use of Test Execution Tools. Addison-Wesley, September 1999.
19. C. Kaner, "Improving the maintainability of automated test suites," Software QA, vol. 4, no. 4, 1997.
20. S. Parsons, "Independent component analysis: A tutorial introduction," Knowl. Eng. Rev., vol. 20, no. 2, pp. 198-199, 2005.
21. A. Hyvärinen and E. Oja, "Independent component analysis: algorithms and applications," Neural Netw., vol. 13, no. 4-5, pp. 411-430, 2000.
22. S. Grant, J. R. Cordy, and D. Skillicorn, "Automated concept location using independent component analysis," in WCRE '08. Washington, DC, USA: IEEE Comp. Soc., 2008, pp. 138-142.
23. D. L. Parnas, "On the criteria to be used in decomposing systems into modules," Communications of the ACM, vol. 15, pp. 1053-1058, 1972.
24. P. L. Tarr, H. Ossher, W. H. Harrison, and S. M. S. Jr., "degrees of separation: Multi-dimensional separation of concerns," in ICSE, 1999, pp. 107-119.
25. W. W. Cohen, "Fast effective rule induction," in Twelfth ICML. Morgan Kaufmann, 1995, pp. 115-123.
26. I. H. Witten and E. Frank, Data Mining: Practical Machine Learning Tools and Techniques. Morgan Kaufmann, 2005.
27. D. L. Bird and C. U. Munoz, "Automatic generation of random self-checking test cases," IBM Syst. J., vol. 22, pp. 229-245, September 1983.
28. R. Hamlet, "Random testing," in Encyclopedia of Software Engineering. Wiley, 1994, pp. 970-978.
29. M. B. Cohen, P. B. Gibbons, W. B. Mugridge, and C. J. Colbourn, "Constructing test suites for interaction testing," in ICSE, 2003, pp. 38-48.
30. M. Grindal, J. Offutt, and S. F. Andler, "Combination testing strategies: a survey," Softw. Test., Verif. Reliab., vol. 15, no. 3, pp. 167-199, 2005.
31. A. Arcuri and L. C. Briand, "A practical guide for using statistical tests to assess randomized algorithms in software engineering," in ICSE, 2011, pp. 1-10.
32. E. J. Weyuker and B. Jeng, "Analyzing partition testing strategies," IEEE Trans. Softw. Eng., vol. 17, no. 7, pp. 703-711, 1991.
33. W. Dickinson, D. Leon, and A. Podgurski, "Finding failures by cluster analysis of execution profiles," in ICSE, 2001, pp. 339-348.
34. J. Wildstrom, P. Stone, E. Witchel, and M. Dahlin, "Machine learning for on-line hardware reconfiguration," in IJCAI'07, San Francisco, CA, USA, 2007, pp. 1113-1118.
35. M. Haran, A. Karr, A. Orso, A. Porter, and A. Sanil, "Applying classification techniques to remotely-collected program execution data," in ESEC/FSE-13. New York, NY, USA: ACM, 2005, pp. 146-155.