A systematic mapping study of mobile application testing techniques

Journal of Systems and Software

Volumn 117, Issue , 2016, Pages 334-356

  Zein, Samer ^a   Salleh, Norsaremah ^a   Grundy, John ^b  

^a INTERNATIONAL ISLAMIC UNIVERSITY MALAYSIA   (Malaysia)

^b SWINBURNE UNIVERSITY OF TECHNOLOGY   (Australia)

Author keywords

Mobile application testing; Software testing; Systematic mapping

Indexed keywords

APPLICATION PROGRAMS; LIFE CYCLE; MAPPING; MOBILE COMPUTING; MOBILE TELECOMMUNICATION SYSTEMS; TESTING;

APPLICATION LIFE CYCLES; DESKTOP APPLICATIONS; DEVELOPMENT ENVIRONMENT; MOBILE APPLICATION TESTING; SECURITY AND USABILITIES; SYSTEMATIC MAPPING; SYSTEMATIC MAPPING STUDIES; TESTING REQUIREMENTS;

SOFTWARE TESTING;

EID: 84963641809     PISSN: 01641212     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jss.2016.03.065     Document Type: Article

References (102)

1. 2014. Robotium. (21/12/2014), Retrieved from https://code.google.com/p/robotium/
2. Adamsen C.Q., Mezzetti G., Møller A. Systematic execution of android test suites in adverse conditions Proceedings of the 2015 International Symposium on Software Testing and Analysis 2015 ACM 83 93
3. Ahmed, M., Ibrahim, R., Ibrahim, N., 2015. An Adaptation Model for Android Application Testing with Refactoring. growth 9.
4. Aktouf O.E.K., Tao Z., Gao J., Uehara T. Testing location-based function services for mobile applications Proceedings of 2015 IEEE Symposium on Service-Oriented System Engineering (SOSE) 2015 308 314
5. Amalfitano D., Amatucci N., Fasolino A.R., Tramontana P. AGRippin: a novel search based testing technique for Android applications Proceedings of the 3rd International Workshop on Software Development Lifecycle for Mobile 2015 ACM 5 12
6. Amalfitano D., Fasolino A.R., Tramontana P. A GUI crawling-based technique for android mobile application testing, software testing Proceedings of 2011 IEEE Fourth International Conference on Verification and Validation Workshops (ICSTW) 2011 252 261
7. Amalfitano D., Fasolino A.R., Tramontana P., Amatucci N. Considering context events in event-based testing of mobile applications Proceedings of 2013 IEEE Sixth International Conference on Software Testing, Verification and Validation Workshops (ICSTW) 2013 126 133
8. Amalfitano D., Fasolino A.R., Tramontana P., De Carmine S., Memon A.M. Using GUI ripping for automated testing of android applications Proceedings of 2012 Proceedings of the 27th IEEE/ACM International Conference on Automated Software Engineering (ASE) 2012 258 261
9. Amalfitano D., Fasolino A.R., Tramontana P., Ta B.D., Memon A.M. MobiGUITAR: automated model-based testing of mobile apps IEEE Softw. 32 2015 53 59
10. Avancini A., Ceccato M. Security testing of the communication among android applications Proceedings of the 8th International Workshop on Automation of Software Test 2013 IEEE Press 57 63
11. Azim T., Neamtiu I. Targeted and depth-first exploration for systematic testing of android apps ACM SIGPLAN Not. 48 2013 641 660
12. Bailey J., Budgen D., Turner M., Kitchenham B., Brereton P., Linkman S.G. Evidence Relating to Object-Oriented Software Design: A Survey 2007 ESEM, Citeseer 482 484
13. Balagtas-Fernandez F., Hussmann H. A methodology and framework to simplify usability analysis of mobile applications Proceedings of the 24th IEEE/ACM International Conference on Automated Software Engineering, ASE '09 2009 520 524
14. Bertini E., Gabrielli S., Kimani S. Appropriating and assessing heuristics for mobile computing Proceedings of the Working Conference on Advanced Visual Interfaces Venezia, Italy 2006 ACM 119 126
15. Biel B., Grill T., Gruhn V. Exploring the benefits of the combination of a software architecture analysis and a usability evaluation of a mobile application J. Syst. Softw. 83 2010 2031 2044
16. Billi M., Burzagli L., Catarci T., Santucci G., Bertini E., Gabbanini F., Palchetti E. A unified methodology for the evaluation of accessibility and usability of mobile applications Univers. Access Inf. Soc. 9 2010 337 356
17. Bjornestad S., Tessem B., Nyre L. Design and evaluation of a location-based mobile news reader Proceedings of the 2011 4th IFIP International Conference on New Technologies, Mobility and Security (NTMS) 2011 1 4
18. Bo J., Xiang L., Xiaopeng G., Zhifang L., Chan W.K. FLOMA: statistical fault localization for mobile embedded system Proceedings of the 2011 3rd International Conference on Advanced Computer Control (ICACC) 2011 396 400
19. Borys M., Milosz M. Mobile application usability testing in quasi-real conditions Proceedings of the 2015 8th International Conference on Human System Interactions (HSI) 2015 IEEE 381 387
20. Braun V., Clarke V. Using thematic analysis in psychology Qual. Res. P sychol. 3 2006 77 101
21. Briseno M.V., Vincent P. Observations on performance of client-server mobile applications Proceedings of the 1st International Conference on Information Technology, IT 2008 2008 1 4
22. Bruegge B., Dutoit A.H. Object-oriented software engineering using UML Patterns and Java-(Required) 2004 Prentice Hall
23. Canfora G., Mercaldo F., Visaggio C.A., D'Angelo M., Furno A., Manganelli C. A case study of automating user experience-oriented performance testing on smartphones Proceedings of the 2013 IEEE Sixth International Conference on Software Testing, Verification and Validation (ICST) 2013 66 69
24. Chan P.P., Hui L.C., Yiu S.-M. Droidchecker: analyzing android applications for capability leak Proceedings of the Fifth ACM Conference on Security and Privacy in Wireless and Mobile Networks 2012 ACM 125 136
25. Choi W., Necula G., Sen K. Guided GUI testing of android apps with minimal restart and approximate learning ACM SIGPLAN Notices 2013 ACM 623 640
26. Costa P., Paiva A.C., Nabuco M. Pattern based GUI testing for mobile applications Proceedings of the 2014 9th International Conference on the Quality of Information and Communications Technology (QUATIC) 2014 IEEE 66 74
27. Crispin L., Gregory J. Agile Testing: A Practical Guide for Testers and Agile Teams 2008 Pearson Education
28. de Cleva Farto G., Endo A.T. Evaluating the model-based testing approach in the context of mobile applications Electron. Notes Theor. Comput. Sci. 314 2015 3 21
29. Delamaro M.E., Vincenzi A.M.R., Maldonado J.C. A strategy to perform coverage testing of mobile applications Proceedings of the 2006 International Workshop on Automation of Software Test Shanghai, China 2006 ACM 118 124
30. Edmondson J., Gokhale A., Sandeep N. Automating testing of service-oriented mobile applications with distributed knowledge and reasoning Proceedings of the 2011 IEEE International Conference on Service-Oriented Computing and Applications (SOCA) 2011 1 4
31. Fenton N., Pfieeger S.L., Glass R.L. Science and substance: a challenge to software engineers Appl. Softw. Metr. 46 1997 6
32. Fenton N., Pfleeger S.L., Glass R.L. Science and substance: a challenge to software engineers IEEE Softw. 11 1994 86 95
33. Fetaji M., Dika Z., Fetaji B. Usability testing and evaluation of a mobile software solution: a case study Proceedings of the 30th International Conference on Information Technology Interfaces, ITI 2008 2008 501 506
34. Flood D., Harrison R., Iacob C. Lessons learned from evaluating the usability of mobile spreadsheet applications Proceedings of the 4th International Conference on Human-Centered Software Engineering Toulouse, France 2012 Springer-Verlag 315 322
35. Franke D., Elsemann C., Kowalewski S. Reverse engineering and testing service life cycles of mobile platforms Proceedings of the 2012 23rd International Workshop on Database and Expert Systems Applications (DEXA) 2012 16 20
36. Franke D., Kowalewski S., Weise C., Prakobkosol N. Testing conformance of life cycle dependent properties of mobile applications Proceedings of the 2012 IEEE Fifth International Conference on Software Testing, Verification and Validation (ICST) 2012 241 250
37. Gao J., Bai X., Tsai W.-T., Uehara T. Mobile application testing: a tutorial Computer 2 2014 46 55
38. Gao J., Tsai W.-T., Paul R., Bai X., Uehara T. Mobile testing-as-a-service (MTaaS) - infrastructures Proceedings of the 2014 IEEE 15th International Symposium on Issues, Solutions and Needs, High-Assurance Systems Engineering (HASE) 2014 IEEE 158 167
39. Griebe T., Hesenius M., Gruhn V. Towards automated UI-tests for sensor-based mobile applications Fujita H. Guizzi G. Intelligent Software Methodologies, Tools and Techniques 2015 Springer International Publishing 3 17
40. Grindal M., Offutt J., Andler S.F. Combination testing strategies: a survey Softw. Test. Verif. Reliab. 15 2005 167 199
41. Guo C., Xu J., Yang H., Zeng Y., Xing S. An automated testing approach for inter-application security in android Proceedings of the 9th International Workshop on Automation of Software Test 2014 ACM 8 14
42. Harrison R., Flood D., Duce D. Usability of mobile applications: literature review and rationale for a new usability model J. Interact. Sci. 1 2013 1 16
43. Hay R., Tripp O., Pistoia M. Dynamic detection of inter-application communication vulnerabilities in android Proceedings of the 2015 International Symposium on Software Testing and Analysis 2015 ACM 118 128
44. Heejin K., Byoungju C., Wong W.E. Performance testing of mobile applications at the unit test level Proceedings of the Third IEEE International Conference on Secure Software Integration and Reliability Improvement, SSIRI 2009 2009 171 180
45. Hu G., Yuan X., Tang Y., Yang J. Efficiently, effectively detecting mobile app bugs with AppDoctor Proceedings of the Ninth European Conference on Computer Systems 2014 ACM 18
46. Hu Y., Azim T., Neamtiu I. Versatile yet lightweight record-and-replay for android Proceedings of the 2015 ACM SIGPLAN International Conference on Object-Oriented Programming, Systems, Languages, and Applications 2015 ACM 349 366
47. Huhn A., Khan V., Lucero A., Ketelaar P. On the use of virtual environments for the evaluation of location-based application Proceedings of the SIGCHI Conference on Human Factors in Computing Systems Austin, Texas, USA 2012 ACM 2569 2578
48. Jiang B., Long X., Gao X. MobileTest: a tool supporting automatic black box test for software on smart mobile devices Proceedings of the Second International Workshop on Automation of Software Test, AST '07 2007 8
49. Johnson R., Wang Z., Stavrou A., Voas J. Exposing software security and availability risks for commercial mobile devices Proceedings of Reliability and Maintainability Symposium (RAMS) 2013 IEEE 1 7
50. Joorabchi M.E., Mesbah A., Kruchten P. Real challenges in mobile app development Proceedings of the 2013 ACM/IEEE International Symposium on Empirical Software Engineering and Measurement 2013 IEEE 15 24
51. Kaasila J., Ferreira D., Kostakos V., Ojala T. Testdroid: automated remote UI testing on android Proceedings of the 11th International Conference on Mobile and Ubiquitous Multimedia Ulm, Germany 2012 ACM 1 4
52. Kitchenham B., Charters S. Guidelines for Performing Systematic Literature Reviews in Software Engineering 2007 School of Computer Science and Mathematics, Keele University
53. Knorr K., Aspinall D. Security testing for Android mHealth apps Proceedings of the 2015 IEEE Eighth International Conference on Software Testing, Verification and Validation Workshops (ICSTW) 2015 IEEE 1 8
54. Kronbauer A.H., Santos C.A.S., Vieira V. Smartphone applications usability evaluation: a hybrid model and its implementation Proceedings of the 4th International Conference on Human-Centered Software Engineering Toulouse, France 2012 Springer-Verlag 146 163
55. Kuhn R., Lei Y., Kacker R. Practical combinatorial testing: beyond pairwise IT Prof. 10 2008 19 23
56. Kumar A., Lee S., Lee W.J. Modeling and test case generation of inter-component communication in android Proceedings of the 2015 2nd ACM International Conference on Mobile Software Engineering and Systems (MOBILESoft) 2015 IEEE 113 116
57. Lettner F., Holzmann C. Automated and unsupervised user interaction logging as basis for usability evaluation of mobile applications Proceedings of the 10th International Conference on Advances in Mobile Computing and Multimedia Bali, Indonesia 2012 ACM 118 127
58. Liang C.-J.M., Lane N.D., Brouwers N., Zhang L., Karlsson B.F., Liu H., Liu Y., Tang J., Shan X., Chandra R. Caiipa: automated large-scale mobile app testing through contextual fuzzing Proceedings of the 20th Annual International Conference on Mobile Computing and Networking 2014 ACM 519 530
59. Looije R., Brake G.M.t., Neerincx M.A. Usability engineering for mobile maps Proceedings of the 4th International Conference on Mobile Technology, Applications, and Systems and the 1st International Symposium on Computer Human Interaction in Mobile Technology Singapore 2007 ACM 532 539
60. Losada B., Urretavizcaya M., Lopez J., Castro I. Combining InterMod agile methodology with usability engineering in a mobile application development Proceedings of the 13th International Conference on Interaccion Persona-Ordenador Elche, Spain 2012 ACM 1 8
61. Lu L., Hong Y., Huang Y., Su K., Yan Y. Activity page based functional test automation for android application Proceedings of the Third World Congress on Software Engineering 2012 IEEE 37 40
62. Lu Y., Zulie P., Jingju L., Yi S. Android malware detection technology based on improved Bayesian classification Proceedings of the 2013 Third International Conference on Instrumentation, Measurement, Computer, Communication and Control (IMCCC) 2013 IEEE 1338 1341
63. Masood M., Thigambaram M. The usability of mobile applications for pre-schoolers Proced.-Soc. Behav. Sci. 197 2015 1818 1826
64. Méndez-Porras A., Quesada-López C., Jenkins M. Automated testing of mobile applications: a systematic map and review Proceedings of the XVIII Ibero-American Conference on Software Engineering, CIBSE 2015 2015 195 208
65. Merwe H.v.d., Merwe B.v.d., Visser W. Verifying android applications using Java PathFinder SIGSOFT Softw. Eng. Notes 37 2012 1 5
66. Morgado I.C., Paiva A.C., Faria J.P. Automated pattern-based testing of mobile applications Proceedings of the 2014 9th International Conference on the Quality of Information and Communications Technology (QUATIC) 2014 IEEE 294 299
67. Muccini H., Di Francesco A., Esposito P. Software testing of mobile applications: challenges and future research directions Proceedings of the 2012 7th International Workshop on Automation of Software Test (AST) 2012 29 35
68. Mujtaba S., Petersen K., Feldt R., Mattsson M. Software Product Line Variability: A Systematic Mapping Study 2008 School of Engineering, Blekinge Institute of Technology
69. Nagowah L., Sowamber G. A novel approach of automation testing on mobile devices Proceedings of the 2012 International Conference on Computer & Information Science (ICCIS) 2012 924 930
70. Oyomno W., Jappinen P., Kerttula E., Heikkinen K. Usability study of ME2.0 Pers. Ubiquitous Comput. 17 2013 305 319
71. Payet É., Spoto F. Static analysis of android programs Inf. Softw. Technol. 54 2012 1192 1201
72. Perry D.E., Porter A.A., Votta L.G. Empirical studies of software engineering: a roadmap Proceedings of the Conference on the Future of Software engineering 2000 ACM 345 355
73. Petersen K., Feldt R., Mujtaba S., Mattsson M. Systematic mapping studies in software engineering Proceedings of the 12th International Conference on Evaluation and Assessment in Software Engineering 2008 1
74. Pham T.P., Razikin K., Goh D.H.-L., Kim T.N.Q., Quach H.N.H., Theng Y.-L., Chua A.Y.K., Lim E.-P. Investigating the usability of a mobile location-based annotation system Proceedings of the 8th International Conference on Advances in Mobile Computing and Multimedia Paris, France 2010 ACM 313 320
75. Puhakka T., Palola M. Towards automating testing of communicational B3G applications Proceedings of the 3rd International Conference on Mobile Technology, Applications & Systems Bangkok, Thailand 2006 ACM 27
76. Ravindranath L., Padhye J., Agarwal S., Mahajan R., Obermiller I., Shayandeh S. AppInsight: mobile app performance monitoring in the wild Proceedings of the 10th USENIX Conference on Operating Systems Design and Implementation Hollywood, CA, USA 2012 USENIX Association 107 120
77. Ryan C., Rossi P. Software, performance and resource utilisation metrics for context-aware mobile applications Proceedings of the 11th IEEE International Symposium on Software Metrics, 2005 2005 10 12
78. Sa M., Carrico L. Lessons from early stages design of mobile applications Proceedings of the 10th International Conference on Human Computer Interaction with Mobile Devices and Services Amsterdam, The Netherlands 2008 ACM 127 136
79. Salva S., Zafimiharisoa S.R. Data vulnerability detection by security testing for android applications Proceedings of Information Security for South Africa, 2013 2013 IEEE 1 8
80. Sama M., Elbaum S., Raimondi F., Rosenblum D.S., Zhimin W. Context-aware adaptive applications: fault patterns and their automated identification IEEE Trans. Softw. Eng. 36 2010 644 661
81. Shahrokni A., Feldt R. A systematic review of software robustness Inf. Softw. Technol. 55 2013 1 17
82. She S., Sivapalan S., Warren I. Hermes: a tool for testing mobile device applications Proceedings of the Software Engineering Conference, ASWEC '09 Australian 2009 121 130
83. Song H., Ryoo S., Kim J.H. An integrated test automation framework for testing on heterogeneous mobile platforms Proceedings of the 2011 First ACIS International Symposium on Software and Network Engineering (SSNE) 2011 IEEE 141 145
84. Starov O. Cloud Platform for Research Crowdsourcing in Mobile Testing 2013 East Carolina University Ann Arbor 12
85. Starov O., Vilkomir S., Gorbenko A., Kharchenko V. Testing-as-a-service for mobile applications: state-of-the-art survey Dependability Problems of Complex Information Systems 2015 Springer 55 71
86. Tao C., Gao J. Modeling mobile application test platform and environment: testing criteria and complexity analysis Proceedings of the 2014 Workshop on Joining AcadeMiA and Industry Contributions to Test Automation and Model-Based Testing 2014 ACM 28 33
87. Vieira V., Holl K., Hassel M. A context simulator as testing support for mobile apps Proceedings of the 30th Annual ACM Symposium on Applied Computing 2015 ACM 535 541
88. Vilkomir S., Amstutz B. Using combinatorial approaches for testing mobile applications Proceedings of the 2014 IEEE Seventh International Conference on Software Testing, Verification and Validation Workshops (ICSTW) 2014 IEEE 78 83
89. Vilkomir S., Marszalkowski K., Perry C., Mahendrakar S. Effectiveness of multi-device testing mobile applications Proceedings of the 2015 2nd ACM International Conference on Mobile Software Engineering and Systems (MOBILESoft) 2015 IEEE 44 47
90. Villanes I.K., Bezerra Costa E.A., Dias-Neto A.C. Automated mobile testing as a service (AM-TaaS) Proceedings of the 2015 IEEE World Congress on Services 2015 IEEE 79 86
91. Wang Z. Validating Context-Aware Applications 2008 The University of Nebraska - Lincoln Ann Arbor 186
92. Wei Q., Chang Z., Cheng Q. Usability study of the mobile library app: an example from Chongqing University Libr. Hi Tech 33 2015 340 355
93. Wen H.-L., Lin C.-H., Hsieh T.-H., Yang C.-Z. PATS: a parallel GUI testing framework for android applications Proceedings of the 2015 IEEE 39th Annual Computer Software and Applications Conference (COMPSAC) 2015 IEEE 210 215
94. Wieringa R., Maiden N., Mead N., Rolland C. Requirements engineering paper classification and evaluation criteria: a proposal and a discussion Requir. Eng. 11 2006 102 107
95. Yu L., Tsai W.T., Jiang Y., Gao J. Generating test cases for context-aware applications using bigraphs Proceedings of the 2014 Eighth International Conference on Software Security and Reliability (SERE) 2014 IEEE 137 146
96. Zhang P., Elbaum S. Amplifying tests to validate exception handling code: an extended study in the mobile application domain ACM Trans. Softw. Eng. Methodol. 23 2014 32
97. Zhang T., Gao J., Cheng J., Uehara T. Compatibility testing service for mobile applications Proceedings of the 2015 IEEE Symposium on Service-Oriented System Engineering 2015
98. Zhauniarovich Y., Philippov A., Gadyatskaya O., Crispo B., Massacci F. towards black box testing of android apps Proceedings of the 2015 10th International Conference on Availability, Reliability and Security (ARES) 2015 IEEE 501 510
99. Zhi-fang L., Bin L., Xiao-peng G. SOA based mobile application software test framework Proceedings of the 8th International Conference on Reliability, Maintainability and Safety, ICRMS 2009 2009 765 769
100. Zhifang L., Bin L., Xiaopeng G. Test automation on mobile device Proceedings of the 5th Workshop on Automation of Software Test Cape Town, South Africa 2010 ACM 1 7
101. Zhifang L., Xiaopeng G., Xiang L. Adaptive random testing of mobile application Proceedings of the 2010 2nd International Conference on Computer Engineering and Technology (ICCET) 2010 V2-297-V292-301
102. Zhimin W., Elbaum S., Rosenblum D.S. Automated generation of context-aware tests Proceedings of the 29th International Conference on Software Engineering, ICSE 2007 2007 406 415