Event-based GUI testing and reliability assessment techniques An experimental insight and preliminary results

Proceedings - 4th IEEE International Conference on Software Testing, Verification, and Validation Workshops, ICSTW 2011

Volumn , Issue , 2011, Pages 212-221

  Belli, Fevzi ^a   Beyazit, Mutlu ^a   Güler, Nevin ^b  

^a UNIVERSITY OF PADERBORN   (Germany)

^b MUGLA SITKI KOCMAN UNIVERSITY   (Turkey)

Author keywords

Event flow graphs; Event sequence graphs; Gui modeling and testing; Reliability modeling assessment prediction

Indexed keywords

CUMULATIVE NUMBER; EVENT SEQUENCE GRAPHS; EVENT-BASED; EVENT-FLOW GRAPH; FAILURE DATA; FAILURE INTENSITY; GUI TESTING; HUMAN-MACHINE SYSTEMS; QUANTITATIVE ASSESSMENTS; RELIABILITY ASSESSMENTS; RELIABILITY MODELING/ ASSESSMENT/PREDICTION; RESEARCH FIELDS; SOFTWARE RELIABILITY ASSESSMENT; WEB-BASED SYSTEM;

COMPUTER SOFTWARE SELECTION AND EVALUATION; GRAPHIC METHODS; GRAPHICAL USER INTERFACES; PROBABILITY DISTRIBUTIONS; RATING; RELIABILITY ANALYSIS; SOFTWARE TESTING;

SOFTWARE RELIABILITY;

EID: 80051638410     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICSTW.2011.59     Document Type: Conference Paper

References (30)

1. B. Beizer, Software Testing Techniques, Van Nostrand Reinhold, 1990.
2. A. M. Memon, M. L. Soffa, M. E. Pollack, "Coverage Criteria for GUI Testing, " Proc. of the 8th European Software Engineering Conference Held Jointly with 9th ACM SIGSOFT International Symposium on Foundations of Software Engineering ESEC/FSE-9, ACM, 2001, pp. 256-267. (Pubitemid 35466930)
3. A.M. Memon, I. Banerjee, A. Nagarajan, "GUI Ripping: Reverse Engineering of Graphical User Interfaces for Testing, " Proceedings of 10th Working Conference on Reverse Engineering (WCRE 2003), IEEE, Nov. 2003, pp. 260-269.
4. GUITAR - a GUI Testing frAmewoRk (GUITAR.dated.11.22.2010), http://guitar.sourceforge.net [Dec. 22, 2010].
5. F. Belli, "Finite-State Testing and Analysis of Graphical User Interfaces, " Proceedings of the 12th International Symposium on Software Reliability Engineering (ISSRE 2001), IEEE CS Press, Nov. 2001, pp. 34-43. (Pubitemid 34080693)
6. F. Belli, C.J. Budnik, and L. White, "Event-based modeling, analysis and testing of user interactions: Approach and case study, " Journal of Software Testing, Verification and Reliability (STVR), vol. 16(1), John Wiley & Sons, Ltd., 2006, pp. 3-32. (Pubitemid 43337974)
7. TSD - Test Suite Designer, Angewandte Datentechnik, University of Paderborn.
8. A.C.R. Paiva, N. Tillmann, J.C.P. Faria, and R.F.A.M. Vidal, "Modeling and Testing Hierarchical GUIs, " Proceedings of 12th International Workshop on Abstract State Machines (ASM 2005), 8- 11 Mar., 2005.
9. R. K. Shehady and D.P. Siewiorek, "A Method to Automate User Interface Testing Using Variable Finite State Machines, " Proc. 27th Int. Symp. Fault-Tolerant Com-puting FTCS, 1997, pp. 80-88.
10. A. Salomaa, I. N. Sneddon, Theory of Automata, Pergamon Press, 1969.
11. J. E. Hopcroft, R. Motwani, J. D. Ullman, Introduction to Automata Theory, Languages and Computation (2nd Edition), Addison-Wesley, 2000.
12. "IEEE Recommended Practice on Software Reliability, " IEEE STD 1633-2008, June 27, 2008, pp.c1-72.
13. "Guidance on Software Aspects of Dependability (IEC 56/1349A/CD:2009), " DIN IEC 62628, March, 2010.
14. Object Management Group, "Unified Modeling Language (UML), " http://www.omg.org/spec/UML/.
15. E.F. Moore, "Gedanken Experiments on Sequential Machines, " Automata Studies, Ann. of Math. Studies No. 34, Princeton U. Press, 1956, pp. 129-153.
16. G.H. Mealy, "A Method for Synthesizing Sequential Circuits, " Bell System, Tech. J 34, Sep. 1955, pp.1045-1079.
17. Q. Xie, A. M. Memon, "Using a Pilot Study to Derive a GUI Model for Automated Testing, " ACM Trans. Softw. Eng. Methodol., vol. 18, no. 2, Nov. 2008, pp. 1-35.
18. J. Edmonds, E.L. Johnson, "Matching, Euler Tours, and the Chinese Postman, " Math. Programming, vol. 5, 1973, pp. 88-124.
19. S. H. Chang, S. S. Choi, J. K. Park, H.G. Kim, "Development of an advanced human-machine interface for next generation nuclear power plants, " Reliability Engineering and System Safety, 64, 1999, pp. 109- 126.
20. M. R. Lyu, Handbook of Software Reliability Engineering, McGraw-Hill, 1996.
21. A. Wood, "Software Reliability Growth Models, " Tandem Tech. Report 96-1, Tandem Computers Inc., Corporate Information Center, Cupertino, Calif., 1996.
22. M. Zhao, M. Xie, "On the log-power model and its applications, " Proceedings of the International Symposium on Software Reliability Engineering, IEEE Computer Society, 1992, pp.14-22.
23. R. Kohavi, "A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection, " Proc. of the Int. Joint Conference on Artificial Intelligence, 1995, pp. 1137-1145.
24. F. Belli, N. Güler, and M. Linschulte, "Are longer test sequences always better?- A Reliability Theoretical Analysis, " Proceedings of the 4th International Conference on Secure Software Integration and Reliability Improvement (SSIRI 2010), IEEE, 2010, pp. 78-85.
25. U. Raja, D. Hale, J. Hale, "Modeling software evolution defects: A time series approach, " Journal of software maintenance and evolution, vol. 21, no. 1, 2009, pp 49-71.
26. ISELTA, http://www.iselta.de/.
27. Complete sets of ESG and EFG models for the case study, http://quebec.upb.de/testbeds2011-models.pdf.
28. J.H. Andrews, L.C. Briand, Y. Labiche, "Is Mutation an Appropriate Tool for Testing Experiments?, " Proc. IEEE Int'l Conf. Software Eng., 2005, pp. 402-411.
29. A.S. Namin, J.H. Andrews, and D.J. Murdoch, "Sufficient Mutation Operator for Measuring Test Effectiveness, " Proc. ICSE, 2008, pp. 351-360.
30. Complete sets of MSE and MAPE goodness of fit measures for the case study, http://quebec.upb.de/testbeds2011-gof.pdf.