Empirical evaluation of the fault-detection effectiveness of smoke regression test cases for GUI-based software

IEEE International Conference on Software Maintenance, ICSM

Volumn , Issue , 2004, Pages 8-17

  Memon, Atif M ^a   Xie, Qing ^a  

^a University of Maryland ^*  (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DAILY AUTOMATED REGRESSION TESTERS (DART); FAULT DETECTION; GUI SOFTWARE; SMOKE REGRESSION TESTS;

AUTOMATION; CODES (SYMBOLS); COMPUTER PROGRAMMING LANGUAGES; ERGONOMICS; GRAPHICAL USER INTERFACES; HUMAN COMPUTER INTERACTION; SOFTWARE ENGINEERING;

COMPUTER SOFTWARE MAINTENANCE;

EID: 18044394956     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICSM.2004.1357785     Document Type: Conference Paper

References (36)

1. Cruise Control, 2003. http://cruisecontrol.sourceforge.net/.
2. Current Daily Builds of AceDB, 2003. http://www.acedb.org/Software/ Downloads/daily.shtml.
3. FAST C++ Compilation - IcrediBuild by Xoreax Software, 2003. http://www.xoreax.com/main.htm.
4. Java Source Code Instrumentation, 2003. http://www.glenmccl.com/instr/ instr.htm.
5. Kinook Software - Automate Software Builds with Visual Build Pro, 2003. http://www.visualbuild.com/.
6. Mozilla, 2003. http://ftp.mozilla.org/pub/mozilla/nightly/latest/.
7. Open WebMail, 2003. http://openwebmail.org/openwebmail/download/redhat/ rpm/dailybuild/.
8. Positive-g- Daily Build Product Information - Mozilla, 2003. http://positive-g.com/dailybuild/.
9. WINE Daily Builds, 2003. http://wine.dataparty.no/.
10. J. Arlat, M. Aguera, L. Amat, Y. Crouzet, J.-C. Fabre, J.C. Laprie, E. Martins, and D. Powell. Fault injection for dependability validation: A methodology and some applications. IEEE Trans. Softw. Eng., 16(2):166-182, 1990.
11. L. Baresi and M. Young. Test oracles. Technical Report CIS-TR-01-02, University of Oregon, Dept. of Computer and Information Science, Eugene, Oregon, U.S.A., August 2001. http://www.cs.uoregon.edu/michal/pubs/oracles.html.
12. L. Crispin, T. House, and C. Wade. The need for speed: automating acceptance testing in an extreme programming environment. In Second International Conference on eXtreme Programming and Flexible Processes in Software Engineering, pages 96-104, 2001.
13. M. Finsterwalder. Automating acceptance tests for GUI applications in an extreme programming environment. In Proceedings of the 2nd International Conference on eXtreme Programming and Flexible Processes in Software Engineering, pages 114-117, May 2001.
14. J. Grenning. Launching extreme programming at a process intensive company. IEEE Software, 18:27-33, 2001.
15. T. J. Halloran and W. L. Scherlis. High quality and open source software practices. In Meeting Challenges and Surviving Success: 2nd Workshop on Open Source Software Engineering, May 2002.
16. M. J. Harrold, A. J. Offut, and K. Tewary. An approach to fault modelling and fault seeding using the program dependence graph. Journal of Systems and Software, 36(3):273-296, Mar. 1997.
17. J. H. Hicinbothom and W. W. Zachary. A tool for automatically generating transcripts of human-computer interaction. In Proceedings of the Human Factors and Ergonomics Society 37th Annual Meeting, volume 2 of SPECIAL SESSIONS: Demonstrations, page 1042, 1993.
18. E.-A. Karlsson, L.-G. Andersson, and P. Leion. Daily build and feature development in large distributed projects. In Proceedings of the 22nd international conference on Software engineering, pages 649-658. ACM Press, 2000.
19. B. Marick. When should a test be automated? In Proceedings of The 11th International Software/Internet Quality Week, May 1998.
20. B. Marick. Bypassing the GUI. Software Testing and Quality Engineering Magazine, pages 41-47, Sept. 2002.
21. S. McConnell. Best practices: Daily build and smoke test. IEEE Software, 13(4): 143-144, July 1996.
22. A. M. Memon. A Comprehensive Framework for Testing Graphical User Interfaces. Ph.D. thesis, Department of Computer Science, University of Pittsburgh, July 2001.
23. A. M. Memon. Advances in GUI testing. In Advances in Computers, ed. by Marvin V. Zelkowitz, volume 57. Academic Press, 2003.
24. A. M. Memon, I. Banerjee, N. Hashmi, and A. Nagarajan. DART: A framework for regression testing nightly/daily builds of GUI applications. In Proceedings of the International Conference on Software Maintenance 2003, pages 410-419, September 2003.
25. A. M. Memon, I. Banerjee, and A. Nagarajan. GUI ripping: Reverse engineering of graphical user interfaces for testing. In Proceedings of The 10th Working Conference on Reverse Engineering, pages 260-269, Nov. 2003.
26. A. M. Memon, I. Banerjee, and A. Nagarajan. What test oracle should I use for effective GUI testing? In Proceedings of the IEEE International Conference on Automated Software Engineering, pages 164-173. IEEE Computer Society, Oct. 12-19 2003.
27. A. M. Memon, M. E. Pollack, and M. L. Soffa. Using a goal-driven approach to generate test cases for GUIs. In Proceedings of the 21st International Conference on Software Engineering, pages 257-266. ACM Press, May 1999.
28. A. M. Memon, M. E. Pollack, and M. L. Soffa. Automated test oracles for GUIs. In Proceedings of the ACM SIGSOFT 8th International Symposium on the Foundations of Software Engineering (FSE-8), pages 30-39, NY, Nov. 8-10 2000.
29. A. M. Memon, M. E. Pollack, and M. L. Soffa. Hierarchical GUI test case generation using automated planning. IEEE Transactions on Software Engineering, 27(2): 144-155, Feb. 2001.
30. A. M. Memon, M. L. Soffa, and M. E. Pollack. Coverage criteria for GUI testing. In Proceedings of the 8th European Software Engineering Conference (ESEC) and 9th ACM SIGSOFT International Symposium on the Foundations of Software Engineering (FSE-9), pages 256-267, Sept. 2001.
31. A. J. Offutt and J. H. Hayes. A semantic model of program faults. In International Symposium on Software Testing and Analysis, pages 195-200, 1996.
32. K. Olsson. Daily build - the best of both worlds: Rapid development and control. Technical report, Swedish Engineering Industries, 1999.
33. C. Poole and J. W. Huisman. Using extreme programming in a maintenance environment. IEEE Software, 18:42-50, 2001.
34. J. Robbins. Debugging Applications. Microsoft Press, 2000.
35. P. Schuh. Recovery, redemption and extreme programming. IEEE Software, 18:34-41, 2001.
36. L. White, H. AlMezen, and N. Alzeidi. User-based testing of GUI sequences and their interactions. In Proceedings of the 12th International Symposium Software Reliability Engineering, pages 54-63, 2001.