Testing Android Mobile Applications: Challenges, Strategies, and Approaches

Advances in Computers

Volumn 89, Issue , 2013, Pages 1-52

  Amalfitano, Domenico ^a   Fasolino, Anna Rita ^a   Tramontana, Porfirio ^a   Robbins, Bryan ^b  

^a UNIVERSITY OF NAPLES FEDERICO II   (Italy)

^b UNIVERSITY OF MARYLAND   (United States)

Author keywords

Android; Android application testing; Mobile; Mobile application testing survey; Mobile application testing techniques; Mobile testing

Indexed keywords

EID: 84875322246     PISSN: 00652458     EISSN: None     Source Type: Book Series    
DOI: 10.1016/B978-0-12-408094-2.00001-1     Document Type: Chapter

References (80)

1. Amalfitano D., Fasolino A.R., Tramontana P. Reverse engineering finite state machines from rich internet applications. Proceedings of the Working Conference on Reverse Engineering (WCRE 2008) 2008, 69-73. IEEE Computer Society Press.
2. D. Amalfitano, A.R. Fasolino, P. Tramontana, Rich internet application testing using execution trace data, in: Proceedings of Second International Workshop on TESTing Techniques and Experimentation Benchmarks for Event-Driven Software (TESTBEDS 2010), IEEE Computer Society Press, pp. 274-283.
3. D. Amalfitano, A.R. Fasolino, P. Tramontana, Techniques and tools for rich internet applications testing, in: Proceedings of the 12th Symposium on Web Systems Evolution (WSE 2010), IEEE Computer Society Press, pp. 63-72.
4. D. Amalfitano, A.R. Fasolino, P. Tramontana, A GUI crawling-based technique for android mobile application testing, in: Third International Workshop on TESTing Techniques and Experimentation Benchmarks for Event-Driven Software (TESTBEDS 2011), IEEE Computer Society Press, pp. 252-261.
5. Android Developers, The Developer's Guide, Activities. <> (accessed 30.07.11). http://developer.android.com/guide/topics/fundamentals/activities.html.
6. Android Developers, The Developer's Guide, ADT Plugins for Eclipse. <> (accessed 30.07.11). http://developer.android.com/sdk/eclipse-adt.html.
7. Android Developers, The Developer's Guide, Android Debug Bridge. <> (accessed on 30.07.11). http://developer.android.com/guide/developing/tools/adb.html.
8. Android Developer, The Developer's Guide, Android Device Emulator. <> (accessed on 30.07.11). http://developer.android.com/guide/developing/tools/emulator.html.
9. Android Developers. The Developer's Guide. Android Virtual Device (AVD). <> (accessed on 30.07.11). http://developer.android.com/guide/developing/devices/index.html.
10. Android Developers, The Developer's Guide, Application Fundamentals. <> (accessed on 30.07.11). http://developer.android.com.
11. Android Developers, The Developer's Guide, Content Providers. <> (accessed on 30.07.11). http://developer.android.com/guide/topics/providers/content-providers.html.
12. Android Developers, The Developer's Guide, Context. <> (accessed on 30.07.11). http://developer.android.com/reference/android/content/Context.html.
13. Android Developers, The Developer's Guide, Designing for Performance. <> (accessed on 30.07.11). http://developer.android.com/guide/practices/design/performance.html.
14. Android Developers, The Developer's Guide, Designing for Responsiveness. <> (accessed on 30.07.11). http://developer.android.com/guide/practices/design/responsiveness.html.
15. Android Developers, The Developer's Guide, Designing for Seamlessness. <> (accessed on 30.07.11). http://developer.android.com/guide/practices/design/seamlessness.html.
16. Android Developers, The Developer's Guide, Designing for Seamlessness. <> (accessed on 30.07.11). http://developer.android.com/reference/android/content/Intent.html.
17. Android Developers, The Developer's Guide, Managing Virtual Devices. <> (accessed on 30.07.11). http://developer.android.com/guide/developing/devices/index.html.
18. Android Developers. The Developer's Guide, Monkeyrunner. <> (accessed on 30.07.11). http://developer.android.com/guide/developing/tools/monkeyrunnerconcepts.html.
19. Android Developers, The Developer's Guide, Android SDK. <> (accessed on 30.07.11). http://developer.android.com/sdk/index.html.
20. Android Developers, The Developer's Guide, Android Security and Permissions. <> (accessed on 30.07.11). http://developer.android.com/guide/topics/security/security.html.
21. Android Developers, The Developer's Guide, Services. <> (accessed on 30.07.11). http://developer.android.com/guide/topics/fundamentals/services.html.
22. Developers, The Developer's Guide, Supporting Multiple Screens. <> (accessed on 30.07.11). http://developer.android.com/guide/practices/screenssupport.html.
23. Android Developers, The Developer's Guide, Testing. <> (accessed on 30.07.11). http://developer.android.com/guide/topics/testing/index.html.
24. Android Developers, The Developer's Guide, UI/Application Exerciser Monkey. <> (accessed on 30.07.11). http://developer.android.com/guide/developing/tools/monkey.html.
25. Android Developer, The Developer's Guide, User Interface Guidelines. <> (accessed on 30.07.11). http://developer.android.com/guide/practices/uiguidelines/index.html.
26. Android Developers, The Developer's Guide, Using DDMS. <> (accessed on 30.07.11). http://developer.android.com/guide/developing/debugging/ddms.html.
27. Android Developers, The Developer's Guide, What is Android? <> (accessed on 30.07.11). http://developer.android.com/guide/basics/what-is-android.html.
28. Au Fiora T.W, Baker Simon, Warren Ian, Dobbie Gillian Automated usability testing framework. Proceedings of the ninth conference on Australasian user interface (AUIC '08) 2008, Vol. 76:55-64. Australian Computer Society, Inc., Darlinghurst, Australia.
29. Apple App Store. <> (accessed on 30.07.11). http://www.apple.com/iphone/apps-for-iphone/.
30. Guardian.co.uk, Apple's iOS App Store reaches 15bn downloads milestone. <> (accessed on 30.07.11). http://www.guardian.co.uk/technology/appsblog/2011/jul/07/apple-iphone-app-store-downloads.
31. Barrera David, Günes Kayacik H., van Oorschot Paul C., Somayaji Anil A methodology for empirical analysis of permission-based security models and its application to android. Proceedings of the 17th ACM conference on Computer and communications security (CCS'10) 2010, 73-84. CM, New York, NY, USA.
32. Belli F., Budnik1 C.J., White L. Event-based modelling, analysis and testing of user interactions: approach and case study. Softw. Test. Verif. Reliab. 2006, (16):3-32.
33. Binder R.V. Testing Object-Oriented Systems- Models, Patterns, and Tools 1999, Addison-Wesley, Boston, MA, USA.
34. Bo J., Xiang L., Xiaopeng G. Mobiletest, A Tool Supporting Automatic Black Box Testing for Software on Smart Mobile Devices. AST '07: Proceedings of the Second International Workshop on Automation of Software Test 2007, 8-14. IEEE Computer Society, Washington, DC, USA.
35. Bryce R.C., Sampath S., Memon A.M. Developing a single model and test prioritization strategies for event-driven software. IEEE Trans. Softw. Eng. 2011, 37(1):48-64.
36. Broekman Bart, Notenboom Edwin Testing embedded software 2003, Pearson Eduction.
37. Jesse Burns, Developing Secure Mobile Applications for Android, ISEC Partners. <> (accessed on 30.07.11). http://www.isecpartners.com/files/iSECSecuringAndroidApps.pdf.
38. Chen T.Y., Kuo F.-C., Merkel R.G., Tse T.H. Adaptive random testing: the ART of test case diversity. J. Sys. Softw. 2009, 10.1016/j.jss.2009.02.022.
39. Delamaro M.E., Vincenzi A.M.R., Maldonado J.C. A strategy to perform coverage testing of mobile applications. Proceedings of the International Workshop on Automation of Software Test (AST '06) 2006, 118-124. ACM, New York, NY, USA.
40. Di Marzio J.F. Android- A Programmer's Guide 2008, McGraw Hill.
41. Doernhoefer M. Software Engineering for Mobile Devices. ACM SIGSOFT Software Engineering Notes 2010, 35(5):8-17.
42. Enck W., Ongtang M., McDaniel P. Understanding android security and privacy. IEEE 2009, 7(1):50-57.
43. Fling B. Mobile Design and Development 2009, O' Reilly.
44. Gartner Newsroom, Gartner Says Android to Become No. 2 Worldwide Mobile Operating System in 2010 and Challenge Symbian for No. 1 Position by 2014. <> (accessed on 30.07.11). http://www.gartner.com/it/page.jsp?id=1434613.
45. Gavalas D., Economou D. Development platforms for mobile applications: status and trends. IEEE Software 2011, 28(1):77-86.
46. Harty Julian Finding usability bugs with automated tests. Queue 2011, 9(1):20-27.
47. C. Hu, I. Neamtiu, Automating GUI Testing for Android Applications, in: Proceedings of AST 2011, 6th International Workshop on Automation of Software Test, ACM Press, pp. 77-83.
48. IEEE Std. 610.12- 1990, Glossary of Software Engineering Terminology, in: Software Engineering Standard Collection, IEEE CS Press, Los Alamitos, California, 1990.
49. Junit, Resources for test driven development. <> (accessed on 30.07.11). http://www.junit.org.
50. H. Kim, B. Choi, W. Eric Wong, Performance testing of mobile applications at the unit test level, in: Proceedings of 2009 Third IEEE International Conference on Secure Software Integration and Reliability Improvement, IEEE Comp. Soc. Press, 171-181.
51. Bastian Könings, Jens Nickels, Florian Schaub, Catching authTokens in the wild the insecurity of google's clientlogin protocol. <> (accessed on 30.07.11). http://www.uni-ulm.de/en/in/mi/staff/koenings/catching-authtokens.html.
52. Landman Max Managing smart phone security risks. 2010 Information Security Curriculum Development Conference (InfoSecCD '10) 2010, 145-155. ACM, New York, NY, USA.
53. Z. Liu, X. Gao, Xiang Long, Adaptive random testing of mobile Application, in: 2nd International Conference on Computer Engineering and Technology (ICCET), 2, 2010, pp. 297-301.
54. Q.H. Mahmoud, Testing wireless java applications, Sun Microsystems-on-line article. <>, 2002 (accessed on 30.07.11). http://www.oracle.com/technetwork/systems/test-156866.html.
55. Maji A.K., Hao K., Sultana S., Bagchi S. Characterizing failures in mobile OSes: a case study with android and symbian. IEEE 21st International Symposium on Software Reliability Engineering 2010, 249-258. IEEE Computer Society Press.
56. Marchetto A., Tonella P., Ricca F. State-based testing of ajax web applications. Proceedings of 2008 International Conference on Software Testing Verification andValidation 2008, 120-130. IEEE CS Press.
57. Memon A., Banerjee L., Nagarajan A. GUI ripping: reverse engineering of graphical user interfaces for testing. Proceedings of the 10th Working Conference on Reverse Engineering (WCRE 2003) 2003, 260-269. IEEE Computer Society Press.
58. Memon Atif, Xie Qing Using transient/persistent errors to develop automated test oracles for event-driven software. 19th IEEE International Conference on Automated Software Engineering (ASE'04) 2004, 186-195. IEEE Computer Society Press.
59. Memon A.M., Xie Q. Studying the fault-detection effectiveness of GUI test cases for rapidly evolving software. IEEE Trans. Softw. Eng. 2005, 31(10):884-896.
60. Memon A.M., Xie Q. Designing and comparing automated test oracles for GUI-based software applications. ACM Transactions Software Engineering and Methodology ACM Press 2007, 16(1).
61. Mesbah A., van Deursen A. Invariant-based automatic testing of AJAX user interfaces. Proceedings of International Conference on Software Engineering (ICSE 2009) 2009, 210-220. IEEE Computer Society Press.
62. Nauman Mohammad, Khan Sohail, Zhang Xinwen Apex: extending Android permission model and enforcement with user-defined runtime constraints. Proceedings of the 5th ACM Symposium on Information, Computer and Communications Security (ASIACCS '10) 2010, 328-332. ACM, New York, NY, USA.
63. Ongtang Machigar, Butler Kevin, McDaniel Patrick Porscha: policy oriented secure content handling in android. Proceedings of the 26th Annual Computer Security Applications Conference (ACSAC '10) 2010, 221-230. ACM, New York, NY, USA.
64. Robotium. <> (accessed on 30.07.11). http://code.google.com/p/robotium/.
65. BBC news online, Google bets on android future. <> (accessed on 30.07.11). http://news.bbc.co.uk/2/hi/7266201.stm.
66. Satoh I. A testing framework for mobile computing software. IEEE Trans. Softw. Eng. 2003, 29(12):1112-1121.
67. Satoh I. Software testing for wireless mobile application. IEEE Wireless Communications 2004, 58-64.
68. Selenium HQ, Web application testing system. <> (accessed on 30.07.11). http://seleniumhq.org/.
69. R.K. Shehady, D.P. Siewiorek, A method to automate user interface testing using variable finite state machines, in: Proceedings of the 27th International Symposium on Fault-Tolerant Computing (FTCS '97), IEEE Computer Society, Washington, DC, USA, pp. 80-88.
70. S. She, S. Sivapalan, I. Warren, Hermes: a tool for testing mobile device applications, in:Proceedings of 2009 Australian Software Engineering Conference, IEEE Compter Society, pp. 123-130.
71. Sensor Simulator. <> (accessed on 30.07.11). http://code.google.com/p/openintents/wiki/SensorSimulator.
72. Sommerville Ian Software Engineering 2006, Pearson Education. eigth ed.
73. Srirama S., Kakumani R., Aggarwal A., Pawar P. Effective testing principles for the mobile data services applications. First International Conference on Communication System Software and Middleware 2006, 1-5. IEEE Computer Society Press, Comsware.
74. Takala T., Katara M., Harty J. Experiences of system-level model-based GUI testing of an android application. Fourth IEEE International Conference on Software Testing, Verification and Validation 2011, 377-386. IEEE Computer Society Press.
75. TalkBack, Eyes-free project. <> (accessed on 30.07.11). http://https://market.android.com/details?id=com.google.android.marvin.talkback.
76. A. Wasserman, Software engineering issues for mobile application development, in:Proceedings of the FSE/SDP Workshop on Future of Software Engineering Research, FOSER 2010, IEEE Computer Society Press, pp. 397-400.
77. Wesson J.L., van der Walt D.F. Implementing mobile services: does the platform really make a difference?. SAICSIT '05: Proceedings of the 2005 Annual Research Conference of the South African Institute of Computer Scientists and Information Technologists on IT Research in Developing Countries 2005, 208-216. South African Institute for Computer Scientists and Information Technologists.
78. White L., Almezen H. Generating test cases for GUI responsibilities using complete interaction sequences. Proceedings of the 11th International Symposium on Software Reliability Engineering (ISSRE '00) 2000, 110-121. IEEE Computer Society, Washington, DC, USA.
79. Wikipedia, List of digital distribution platforms for mobile devices. <> (accessed on 30.07.11). http://en.wikipedia.org/wiki/Listofdigitaldistributionplatformsformobiledevices.
80. Yuan X., Memon A.M. Generating event sequence-based test cases using GUI run-time state. IEEE Trans. Softw. Eng. 2010, 36(1):81-95.