Invariant-based automatic testing of modern web applications

IEEE Transactions on Software Engineering

Volumn 38, Issue 1, 2012, Pages 35-53

  Mesbah, Ali ^a   Van Deursen, Arie ^b   Roest, Danny ^b  

^a UNIVERSITY OF BRITISH COLUMBIA   (Canada)

^b Department of Microelectronics   (Netherlands)

Author keywords

Ajax; Automated testing; web applications

Indexed keywords

AJAX; AUTOMATED TESTING; BACK-BUTTON; CLIENT/SERVER; DOM TREE; ERROR MESSAGES; ERROR PRONES; INTERFACE STATE; INVARIANT CHECKING; RUNTIMES; WEB 2.0 APPLICATIONS; WEB APPLICATION;

AUTOMATIC TESTING; USER INTERFACES; WORLD WIDE WEB;

JAVA PROGRAMMING LANGUAGE;

EID: 84856558128     PISSN: 00985589     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSE.2011.28     Document Type: Article

References (40)

1. A. Andrews, J. Offutt, and R. Alexander, "Testing Web Applications by Modeling with FSMs," Software and Systems Modeling, vol. 4, no. 3, pp. 326-345, July 2005. (Pubitemid 40984097)
2. S. Artzi, A. Kieżun, J. Dolby, F. Tip, D. Dig, A. Paradkar, and M.D. Ernst, "Finding Bugs in Dynamic Web Applications," Proc. Int'l Symp. Software Testing and Analysis, pp. 261-272, 2008.
3. M. Barnett, R. Deline, M. Fahndrich, K. Rustan, M. Leino, and W. Schulte, "Verification of Object-Oriented Programs with Invariants," J. Object Technology, vol. 3, no. 6, pp. 1-30, 2004.
4. M. Benedikt, J. Freire, and P. Godefroid, "VeriWeb: Automatically Testing Dynamic Web Sites," Proc. 11th Int'l Conf. World Wide Web, pp. 654-668, 2002.
5. A. Bertolino, "Software Testing Research: Achievements, Challenges, Dreams," Proc. ICSE Future of Software Eng., pp. 85-103, 2007. (Pubitemid 47484919)
6. C.P. Bezemer, A. Mesbah, and A. Van Deursen, "Automated Security Testing of Web Widget Interactions," Proc. Seventh Joint Meeting of the European Software Eng. Conf. and the ACM SIGSOFT Symp. The Foundations of Software Eng., pp. 81-91, 2009.
7. R.V. Binder, Testing Object-Oriented Systems: Models, Patterns, and Tools. Addison-Wesley, 1999.
8. L.A. Clarke and D.S. Rosenblum, "A Historical Perspective on Runtime Assertion Checking in Software development," ACM SIGSOFT Software Eng. Notes, vol. 31, no. 3, pp. 25-37, 2006.
9. L. de Alfaro, "Model Checking the World Wide Web," Proc. 13th Int'l Conf. Computer Aided Verification, pp. 337-349, 2001.
10. L. de Alfaro, T.A. Henzinger, and F.Y.C. Mang, "MCWEB: A Model-Checking Tool for Web Site Debugging," Proc. World Wide Web Conf., posters, 2001.
11. S. Elbaum, G. Rothermel, S. Karre, and M. Fisher II, "Leveraging User-Session Data to Support Web Application Testing," IEEE Trans. Software Eng., vol. 31, no. 3, pp. 187-202, Mar. 2005. (Pubitemid 40890001)
12. M.D. Ernst, J. Cockrell, W.G. Griswold, and D. Notkin, "Dynamically Discovering Likely Program Invariants to Support Program Evolution," IEEE Trans. Software Eng., vol. 27, no. 2, pp. 99-123, Feb. 2001. (Pubitemid 32254259)
13. J. Garrett, "Ajax: A New Approach to Web Applications," adaptive path, http://www.adaptivepath.com/publications/essays/archives/000385. php, Feb. 2005.
14. F. Groeneveld, A. Mesbah, and A. Van Deursen, "Automatic Invariant Detection in Dynamic Web Applications," Technical Report TUD-SERG-2010-037, Delft Univ. of Technology, 2010.
15. W. Halfond, S. Anand, and A. Orso, "Precise Interface Identification to Improve Testing and Analysis of Web Applications," Proc. 18th Int'l Symp. Software Testing and Analysis, pp. 285-296, 2009.
16. W. Halfond and A. Orso, "Improving Test Case Generation for Web Applications Using Automated Interface Discovery," Proc. Sixth Joint Meeting of the European Software Eng. Conf. and the ACM SIGSOFT Symp. The Foundations of Software Eng., pp. 145-154, 2007.
17. W. Halfond and A. Orso, "Automated Identification of Parameter Mismatches in Web Applications," Proc. 16th Int'l Symp. Foundations of Software Eng., pp. 181-191, 2008.
18. Y.W. Huang, C.H. Tsai, T.P. Lin, S.K. Huang, D.T. Lee, and S.Y. Kuo, "A Testing Framework for Web Application Security Assessment," J. Computer Networks, vol. 48, no. 5, pp. 739-761, 2005. (Pubitemid 40684160)
19. S. Kals, E. Kirda, C. Kruegel, and N. JoVanovic, "Secubat: A Web Vulnerability Scanner," Proc. 15th Int'l Conf. World Wide Web, pp. 247-256, 2006. (Pubitemid 46946617)
20. V.L. Levenshtein, "Binary Codes Capable of Correcting Deletions, Insertions, and Reversals," Cybernetics and Control Theory, vol. 10, pp. 707-710, 1996.
21. A. Marchetto, F. Ricca, and P. Tonella, "A Case Study-Based Comparison of Web Testing Techniques Applied to Ajax Web Applications," Int'l J. Software Tools for Technology Transfer, vol. 10, no. 6, pp. 477-492, 2008.
22. A. Marchetto, P. Tonella, and F. Ricca, "State-Based Testing of Ajax Web Applications," Proc. IEEE First Int'l Conf. Software Testing Verification and Validation, pp. 121-130, 2008.
23. A. Memon, "An Event-Flow Model of GUI-Based Applications for Testing: Research Articles," Software Testing, Verification and Reliability, vol. 17, no. 3, pp. 137-157, 2007. (Pubitemid 47354557)
24. A. Mesbah, E. Bozdag, and A. Van Deursen, "Crawling Ajax by Inferring User Interface State Changes," Proc. Eighth Int'l Conf. Web Eng., pp. 122-134, 2008.
25. A. Mesbah and A. Van Deursen, "Migrating Multi-Page Web Applications to Single-Page Ajax Interfaces," Proc. 11th European Conf. Software Maintenance and Reeng., pp. 181-190, 2007. (Pubitemid 47213994)
26. A. Mesbah and M. Prasad, "Automated Cross-Browser Compatibility Testing," Proc. 33rd Int'l Conf. Software Eng., 2011.
27. A. Mesbah and A. Van Deursen, "A Component-and Push-Based Architectural Style for Ajax Applications," J. Systems and Software, vol. 81, no. 12, pp. 2194-2209, 2008.
28. A. Mesbah and A. Van Deursen, "Invariant-Based Automatic Testing of Ajax User Interfaces," Proc. IEEE 31st Int'l Conf. Software Eng., pp. 210-220, 2009.
29. B. Meyer, "Seven Principles of Software Testing," Computer, vol. 41, no. 8, pp. 99-101, Aug. 2008.
30. K. Pattabiraman and B. Zorn, "DoDOM: Leveraging DOM Invariants for Web 2.0 Application Robustness Testing," Proc. IEEE 21st Int'l Conf. Software Reliability Eng., 2010.
31. F. Ricca and P. Tonella, "Analysis and Testing of Web Applications," Proc. 23rd Int'l Conf. Software Eng., pp. 25-34, 2001. (Pubitemid 32485635)
32. D. Roest, "Automated Regression Testing of Ajax Web Applications," master's thesis, Delft Univ. of Technology, Feb. 2010.
33. D. Roest, A. Mesbah, and A. Van Deursen, "Regression Testing Ajax Applications: Coping with Dynamism," Proc. Third Int'l Conf. Software Testing, Verification and Validation, pp. 128-136, 2010.
34. S. Sprenkle, E. Gibson, S. Sampath, and L. Pollock, "Automated Replay and Failure Detection for Web Applications," Proc. IEEE/ACM 20th Int'l Conf. Automated Software Eng., pp. 253-262, 2005.
35. S. Sprenkle, L. Pollock, H. Esquivel, B. Hazelwood, and S. Ecott, "Automated Oracle Comparators for Testing Web Applications," Proc. IEEE 18th Int'l Symp. Software Reliability, pp. 117-126, 2007.
36. B. Stepien, L. Peyton, and P. Xiong, "Framework Testing of Web Applications Using TTCN-3," Int'l J. Software Tools for Technology Transfer, vol. 10, no. 4, pp. 371-381, 2008.
37. G. Wassermann and Z. Su, "Static Detection of Cross-Site Scripting Vulnerabilities," Proc. 30th Int'l Conf. Software Eng., pp. 171-180, 2008.
38. E.J. Weyuker, "On Testing Non-Testable Programs," The Computer J., vol. 25, no. 4, pp. 465-470, 1982.
39. J.Y. Yen, "Finding the k Shortest Loopless Paths in a Network," Management Science, vol. 17, no. 11, pp. 712-716, 1971.
40. R.K. Yin, Case Study Research: Design and Methods, third ed. Sage Publications, Inc., 2003.