On the accuracy, efficiency, and reusability of automated test oracles for android devices

IEEE Transactions on Software Engineering

Volumn 40, Issue 10, 2014, Pages 957-970

  Lin, Ying Dar ^a   Rojas, Jose F ^a   Chu, Edward T H ^b   Lai, Yuan Cheng ^c  

^a NATIONAL CHIAO TUNG UNIVERSITY   (Taiwan)

^b NATIONAL YUNLIN UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Taiwan)

^c NATIONAL TAIWAN UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Taiwan)

Author keywords

Reusable software; test execution; testing tools; user interfaces

Indexed keywords

AUTOMATED TEST; REUSABLE SOFTWARES; TEST EXECUTION; TESTING TOOLS;

USER INTERFACES;

EID: 84908027299     PISSN: 00985589     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSE.2014.2331982     Document Type: Article

References (35)

1. Microsoft MSDN. (2013, Mar. ). Guidelines for touch interaction [Online]. Available: http://msdn. microsoft. com/en-us/library/ cc872774. aspx
2. A. M. Memon, M. E. Pollack, and M. L. Soffa, "Automated test oracles for GUIs," ACM SIGSOFT Softw. Eng. Notes, vol. 25, pp. 30-39, 2000.
3. L. Baresi and M. Young, "Test oracles," University of oregon, Dept. of Computer and Information Science, Tech. Rep. CISTR-01-02," Eugene, OR, U. S. A., [Online]. Available: http://www. cs. uoregon. edu/michal/pubs/oracles. html, Aug. 2001.
4. Q. Xie and A. M. Memon, "Model-based testing of communitydriven open-source GUI applications," in Proc. IEEE 22nd Int. Conf. Softw. Maintenance, Sep. 2006, pp. 145-154.
5. T. Takala, M. Katara, and J. Harty, "Experiences of systemlevel model-based GUI testing of an android application," in Proc. IEEE 4th Int. Conf. Softw. Testing, Verification Validation, 2011, pp. 377-386.
6. Y. D. Lin, T.-H. Chu Edward, S. C. Yu, and Y. C. Lai, "Improving the accuracy of automated GUI testing for embedded systems," IEEE Softw., vol. 31, no. 1, pp. 39-45, Jan. 2014.
7. M. Grechanik, Q. Xie, and C. Fu, "Creating GUI testing tools using accessibility technologies," in Proc. IEEE Int. Conf. Softw. Testing, Verification, Validation Workshops, 2009, pp. 243-250.
8. J. Kaasila, D. Ferreira, V. Kostakos, and T. Ojala, "Testdroid: Automated remote UI testing on android," in Proc. 11th Int. Conf. Mobile Ubiquitous Multimedia, Ulm, Germany, 2012, pp. 28:1-28:4.
9. T.-H. Chang, T. Yeh, and R. C. Miller, "GUI testing using computer vision," in Proc. SIGCHI Conf. Human Factors Comput. Syst., Atlanta, GA, USA, 2010, pp. 1535-1544.
10. Android screencast, an open-source remote control tool for Android devices. (2013, Mar. ) [Online]. Available: http://code. google. com/p/androidscreencast/
11. G. Pass and R. Zabih, "Comparing images using joint histograms," Multimedia Systems, vol. 7, no. 3, pp. 234-240, May 1999.
12. H. Bay, A. Ess, T. Tuytelaars, and L. Van Gool, "SURF: Speeded up robust features," Comput. Vis. Image Understanding, vol. 110, pp. 346-359, 2008.
13. Opencv, template matching. (2013, Mar. ) [Online]. Available: http://docs. opencv. org/doc/tutorials/imgproc/histograms/ template-matching/template-matching. html
14. T. Takala, M. Katara, and J. Harty, "Experiences of system-level model-based GUI testing of an android application," in Proc. IEEE 4th Int. Conf. Softw. Testing, Verification Validation, 2011, pp. 377-386.
15. Android MonkeyRunner. (2013, Mar. ) [Online]. Available: http:// developer. android. com/tools/help/monkeyrunner-concepts. html
16. Robotium framework homepage. (2013, Mar. ) [Online]. Available: http://code. google. com/p/robo tium/
17. Android GUITAR, a model-based system for automated GUI testing. (2013, Mar. ) [Online]. Available: http://sourceforge. net/ apps/mediawiki/guitar/index. php?titleGUITAR-Home-Page
18. Android developer guide, instrumentation. (2013, Jun. ) [Online]. Available: http://developer. android. com/reference/android/ app/Instrumentation. html
19. Android developer guide, application fundamentals. (2013, Mar. ) [Online]. Available: http://developer. android. com/ guide/components/fundamentals. html
20. A. M. Memon, "GUI testing: Pitfalls and process," IEEE Comput., vol. 35, no. 8, pp. 87-88, Aug. 2002.
21. W3C working group note 11 February 2004, web services glossary [Online]. Availabe: http://www. w3. org/TR/ws-gloss/, Apr. 2013.
22. Apache CXF: An open-source services framework. (2013, Apr. ) [Online]. Available: http://cxf. apache. org/
23. Windows communication foundation. (2013, Apr. ) [Online]. Available: http://msdn. microsoft. com/en-us/library/ms731082. aspx
24. EmguCV. (2013, Apr. ) [Online]. Available: http://www. emgu. com/wiki/index. php/Main-Page
25. R. Laganiere, OpenCV 2 Computer Vision Application Programming Cookbook. Birmingham, U. K. : Packt Publishing, May 2011.
26. W3C working group, web services architecture. (2013, Jun. ) [Online]. Available:http://www. w3. org/TR/ws-arch/#id2260892
27. Android, hierarchy viewer. (2013, Jun. ) [Online]. Available: http:// developer. android. com/tools/help/hierarchy-viewer. html
28. SPAG-C live demo. (2013, Jun. ) [Online]. Available: http://youtu. be/V841LpD4ULo
29. C. Hu and I. Neamtiu, "Automating GUI testing for android applications," in Proc. 6th Int. Workshop Autom. Softw. Test, 2011, pp. 77-83.
30. S. Anand, M. Naik, M. J. Harrold, and H. Yang, "Automated concolic testing of smartphone apps," in Proc. ACM SIGSOFT 20th Int. Symp. Found. Softw. Eng., 2012, pp. 59:1-59:11.
31. W. Choi, G. Necula, and K. Sen, "Guided GUI testing of android apps with minimal restart and approximate learning," in Proc. ACM SIGPLAN Int. Conf. Object Oriented Program. Syst. Lang. Appl., New York, NY, USA, 2013, pp. 623-640.
32. N. Mirzaei, S. Malek, C. S. Pasareanu, N. Esfahani, and R. Mahmood, "Testing android apps through symbolic execution," ACM SIGSOFT Softw. Eng. Notes, vol. 37, pp. 1-5, 2012.
33. R. Mahmood, N. Esfahani, T. Kacem, N. Mirzaei, S. Malek, and A. Stavrou, "A whitebox approach for automated security testing of android applications on the cloud," in Proc. 7th Int. Workshop Autom. Softw. Test, 2012, pp. 22-28.
34. A. Machiry, R. Tahiliani, and M. Naik, "Dynodroid: An input generation system for android apps," in Proc. 9th Joint Meeting Found. Softw. Eng., Saint Petersburg, Russia, 2013, pp. 224-234.
35. D. Amalfitano, A. R. Fasolino, and P. Tramontana, "A GUI crawling-based technique for android mobile application testing," in Proc. IEEE 4th Int. Conf. Softw. Testing, Verification Validation Workshop, 2011, pp. 252-261.