A systematic mapping study on the combination of static and dynamic quality assurance techniques

Information and Software Technology

Volumn 54, Issue 1, 2012, Pages 1-15

  Elberzhager, Frank ^a   Münch, Jürgen ^a,b   Nha, Vi Tran Ngoc ^c  

^a FRAUNHOFER IESE   (Germany)

^b UNIVERSITY OF HELSINKI   (Finland)

^c Rheinland Pfälzische Technische Universität Kaiserslautern Landau   (Germany)

Author keywords

Combination; Dynamic quality assurance; Inspection; Static quality assurance; Systematic mapping study; Testing

Indexed keywords

INSPECTION; INTEGRATION; MAPPING; QUALITY ASSURANCE; TESTING;

COMBINATION; DYNAMIC QUALITY; FUTURE RESEARCH DIRECTIONS; HIGH-QUALITY PRODUCTS; MULTIPLE CRITERIA; STATIC AND DYNAMIC ANALYSIS; SYSTEMATIC MAPPING STUDIES; THEMATIC ANALYSIS;

INTEGRATION TESTING;

EID: 80055068778     PISSN: 09505849     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.infsof.2011.06.003     Document Type: Review

References (74)

1. T.F. Chang, A. Danylyzsn, S. Norimatsu, J. Rivera, D. Shepard, A. Lattanze, J. Tomayko, "Continuous verification" in mission critical software development, in: Proceedings of the Thirtieth Hawaii International Conference on System Sciences, 1997, pp. 273-284.
2. A. Endres, and D. Rombach A Handbook of Software and Systems Engineering 2003 Addison Wesley
3. Y. Chen, S. Liu, W.E Wong, A method combining review and testing for verifying software systems, in: Proceedings of the 2008 International Conference on BioMedical Engineering and Informatics, 2008, pp. 827-831.
4. A. Hanna, H.Z. Ling, X. Yang, M. Debbabi, A synergy between static and dynamic analysis for the detection of software security vulnerabilities, in: Proceedings of the Confederated International Conferences, CoopIS, DOA, IS, and ODBASE 2009 on On the Move to Meaningful Internet Systems: Part II, 2009, pp. 815-832.
5. D.M. Zimmerman, J.R. Kiniry, A verification-centric software development process for Java, in: Proceedings of the 9th International Conference on Quality Software, 2009, pp. 76-85.
6. M. Roper, M. Wood, and J. Miller An empirical evaluation of defect detection techniques Information and Software Technology 39 11 1997 763 775 (Pubitemid 127371614)
7. S.S. So, S.D. Cha, T.J. Shimeall, and Y.R. Kwon An empirical evaluation of six methods to detect faults in software Software Testing, Verification and Reliability 12 3 2002 155 171
8. E. Kamsties, C.M. Lott, An empirical evaluation of three defect-detection techniques, in: 5th European Software Engineering Conference, 1995, pp. 362-383.
9. R. Conradi, A.S. Marjara, B. Skatevik, An empirical study of inspection and testing data at Ericsson, Norway, in: 24th NASA Software Engineering Workshop, 1999, pp. 1-7.
10. C. Andersson, T. Thelin, P. Runeson, N. Dzamashvili, An experimental evaluation of inspection and testing for detection of design faults, in: Proceedings of the 2003 International Symposium on Empirical Software Engineering, 2003, pp. 174-184.
11. T. Berling, T. Thelin, An industrial case study of the verification and validation activities, in: Proceedings of the 9th International Symposium on Software Metrics, 2003, pp. 226-238.
12. T.Y. Chen, P.L. Poon, S.F. Tang, T.H. Tse, and Y.T. Yu Applying testing to requirements inspection for software quality assurance Information Systems Control Journal 6 2006 50 56
13. P. Massicotte, L. Badri, and M. Badri Aspects-classes integration testing strategy: an incremental approach Rapid Integration of Software Engineering Techniques 3943 2006 158 173 (Pubitemid 44029904)
14. P. Godefroid, P. de Halleux, A.V. Nori, S.K. Rajamani, W. Schulte, and N. Tillmann Automating software testing using program analysis IEEE Software 25 5 2008 30 37
15. C. Csallner, Y. Smaragdakis, Check 'n' crash: combining static checking and testing, in: Proceedings of the 27th International Conference on Software engineering, 2005, pp. 422-431.
16. C. Artho, and A. Biere Combined static and dynamic analysis Electronic Notes in Theoretical Computer Science 131 2005 3 14 (Pubitemid 40708989)
17. J. Chen, H. Zhou, S.D. Bruda, Combining model checking and testing for software analysis, in: Proceedings of the 2008 International Conference on Computer Science and Software Engineering, 2008, pp. 206-209.
18. O. Chebaro, N. Kosmatov, A. Giorgetti, and J. Julliand Combining static analysis and test generation for C program debugging Tests and Proofs 6143 2010 94 100
19. P. Centonze, R. Flynn, M. Pistoia, Combining static and dynamic analysis for automatic identification of precise access-control policies, in; Proceedings of the 23rd Annual Computer Security Applications Conference, 2007, pp. 292-303.
20. F.D. Anger, R.V. Rodriguez, M. Young, Combining static and dynamic analysis of concurrent programs, in: Proceedings of the International Conference on Software Maintenance, 1994, pp. 89-98.
21. M. Wood, M. Roper, A. Brooks, J. Miller, Comparing and combining software defect detection techniques - a replicated empirical study, in: 6th European Software Engineering Conference, 1997, pp. 262-277. (Pubitemid 127132032)
22. S. Wagner, J. Jürjens, C. Koller, P. Trischberger, Comparing bug finding tools with reviews and test, in: Proceedings of the 17th International Conference on Testing of Communicating Systems, 2005, pp. 40-55. (Pubitemid 41322192)
23. V.R. Basili, and R.W. Selby Comparing the effectiveness of software testing strategies IEEE Transactions on Software Engineering 13 12 1987 1278 1296
24. M.E. Fagan Design and code inspections to reduce errors in program development IBM Systems Journal 15 3 1976 182 211
25. P. Runeson, A. Andrews, Detection or isolation of defects? An experimental comparison of unit testing and code inspection, in: Proceedings of the 14th International Symposium on Software Reliability Engineering, 2003, pp. 3-13.
26. C. Csallner, Y. Smaragdakis, and T. Xie DSD-Crasher: a hybrid analysis tool for bug finding ACM Transactions on Software Engineering and Methodology 17 2 2008 1 37
27. S. Zhang, Y. Lin, Z. Gu, J. Zhao, Effective identification of failure-inducing changes: a hybrid approach, in: Proceedings of the 8th ACM SIGPLAN-SIGSOFT Workshop on Program Analysis for Software Tools and Engineering, 2008, pp. 77-83.
28. M. Gopinathan, S.K. Rajamani, Enforcing object protocols by combining static and runtime analysis, in: Proceedings of the 23rd ACM SIGPLAN Conference on Object-oriented Programming Systems Languages and Applications, 2008, pp. 245-260.
29. Engineering Village. < http://www.engineeringvillage2.org >.
30. L. Franz, and J. Shih Estimating the value of inspections and early testing for software projects Hewlett-Packard Journal 45 1994 60 67
31. N. Juristo, and S. Vegas Functional testing, structural testing, and code reading: what fault type do they each detect? Empirical Methods and Studies in Software Engineering 2003 208 232
32. B.A. Kitchenham, S. Charters, Guidelines for Performing Systematic Literature Reviews in Software Engineering, Technical Report EBSE-2007-01, Keele University and University of Durham, 2007.
33. Q. Chen, L. Wang, Z. Yang, S.D. Stoller, HAVE: detecting atomicity violations via integrated dynamic and static analysis, in: Proceedings of the 12th International Conference on Fundamental Approaches to Software Engineering: Held as Part of the Joint European Conferences on Theory and Practice of Software, 2009, pp. 425-439.
34. Health, Social, and Economic Research, The Economic Impacts of Inadequate Infrastructure for Software Testing, National Institute of Standards and Technology, 2002.
35. Q. Chen, L. Wang, Z. Yang, HEAT: an integrated static and dynamic approach for thread escape analysis, in: Proceedings of the 33rd Annual IEEE International Computer Software and Applications Conference, 2009, pp. 142-147.
36. P.D. Kumar, A. Nema, R. Kumar, Hybrid analysis of executables to detect security vulnerabilities: security vulnerabilities, in: Proceedings of the 2nd India Software Engineering Conference, 2009, pp. 141-148.
37. IEEE Standard 610.12-1990. IEEE Standard Glossary of Software Engineering Terminology, 1990.
38. D. Winkler, B. Riedl, S. Biffl, Improvement of design specifications with inspection and testing, in: Proceedings of the 31st Euromicro Conference on Software Engineering and Advanced Applications, 2005, pp. 222-231.
39. F. Lanubile, T. Mallardo, Inspecting automated test code: a preliminary study, in: Proceedings of the 8th International Conference on Agile Processes in Software Engineering and Extreme Programming, 2007, pp. 115-122.
40. N. Ward, Integrated formal verification and validation of safety critical software, in: Proceedings of the Aerospace Software Engineering for Advanced Systems Architectures Conference, 1993, pp. 10-13.
41. S. Liu, Integrating specification-based review and testing for detecting errors in programs, in: Proceedings of the 9th International Conference on Formal Methods and Software Engineering, 2007, pp. 136-150.
42. A. Aggarwal, P. Jalote, Integrating static and dynamic analysis for detecting vulnerabilities, in: 30th Annual International Conference on Computer Software and Applications, 2006, pp. 343-350. (Pubitemid 46661666)
43. G.A.D. Lucca, M.D. Penta, Integrating static and dynamic analysis to improve the comprehension of existing web applications, in: Proceedings of the 7th IEEE International Symposium on Web Site Evolution, 2005, pp. 87-94. (Pubitemid 44419185)
44. S. Liu, T. Tamai, S. Nakajima, Integration of formal specification, review, and testing for software component quality assurance, in: Proceedings of the 2009 ACM symposium on Applied Computing, 2009, pp. 415-421.
45. D. Winkler, S. Biffl, and K. Faderl Investigating the temporal behavior of defect detection in software inspection and inspection-based testing Product-Focused Software Process Improvement 6156 2010 17 31
46. M. Klaes, F. Elberzhager, H. Nakao, Managing software quality through a hybrid defect content and effectiveness model, in: Proceedings of the 2nd ACM-IEEE International Symposium on Empirical Software Engineering and Measurement, 2008, pp. 321-323.
47. F. Elberzhager, J. Muench, D. Rombach, B. Freimut, Optimizing cost and quality by integrating inspection and test processes, in: International Conference on Software and Systems Process, 2011, pp. 3-12.
48. K.E. Wiegers Peer Reviews in Software 2002 Addison-Wesley
49. I. Burnstein Practical Software Testing 2002 Springer
50. P. Joshi, K. Sen, M. Shlimovich, Predictive testing: amplifying the effectiveness of software testing, in: Proceedings of the 6th Joint Meeting of the European Software Engineering Conference and the ACM SIGSOFT Symposium on the Foundations of Software Engineering, 2007, pp. 561-564. (Pubitemid 351438721)
51. P. Jalote, V. Vangala, T. Singh, P. Jain, Program partitioning: a framework for combining static and dynamic analysis, in: Proceedings of the 2006 International Workshop on Dynamic Systems Analysis, 2006, pp. 11-16.
52. N. Juristo, A.M. Moreno, and S. Vegas Reviewing 25 years of testing technique experiments Empirical Software Engineering 9 1-2 2004 7 44
53. D. Balzarotti, M. Cova, V. Felmetsger, N. Jovanovic, E. Kirda, C. Kruegel, G. Vigna, Saner: composing static and dynamic analysis to validate sanitization in web applications, in: Proceedings of the 2008 IEEE Symposium on Security and Privacy, 2008, pp. 387-401.
54. P. Strooper, M. Wojcicki, Selecting V&V technology combinations: how to pick a winner? in: Proceedings of the 12th International Conference on Engineering Complex Computer Systems, 2007, pp. 87-96.
55. R. Pressman Software Engineering: A Practitioner's Approach fifth ed. 2000 McGraw-Hill London
56. T. Gilb, and D. Graham Software Inspections 1993 Addison-Wesley
57. C. Jones Software project management practices: failure versus success CrossTalk - The Journal of Defense Software Engineering 17 10 2004 5 9 (Pubitemid 40659456)
58. A. Aurum, H. Petersson, and C. Wohlin State-of-the-art: software inspections after 25 years Software Testing, Verification and Reliability 12 3 2002 133 154
59. O. Laitenberger, Studying the effects of code inspection and structural testing on software quality, in: Proceedings of the 9th International Symposium on Software Reliability Engineering, 1998, pp. 237-246.
60. S. Kollanus, J. Koskinen, Survey of software inspection research: 1991-2005, Computer Science and Information Systems reports, Working Papers WP-40, University of Jyväskylä, Finland, 2007.
61. K. Petersen, R. Feldt, S. Mujtaba, M. Mattsson, Systematic mapping studies in software engineering, in: Proceedings of the 12th International Conference on Evaluation and Assessment in Software Engineering, 2008, pp. 1-10.
62. F. Iturbe, Systematic testing and reviewing, in: Proceedings of the 11th International Conference on Software Engineering and Knowledge Engineering, 1999, pp. 295-299.
63. A. Gupta, P. Jalote, Test inspected unit or inspect unit tested code? in: Proceedings of the 1st International Symposium on Empirical Software Engineering and Measurement, 2007, pp. 51-60.
64. M.J. Harrold, Testing: a roadmap, in: International Conference on Software Engineering, The Future of Software Engineering, 2000, pp. 61-72.
65. J.R. Landis, and G.G. Koch The measurement of observer agreement for categorical data Biometrics 33 1 1977 159 174 (Pubitemid 8054849)
66. P. Anderson The use and limitations of static-analysis tools to improve software quality CrossTalk: The Journal of Defense Software Engineering 21 6 2008 18 21
67. A.V. Nori, S.K. Rajamani, S. Tetali, A.V. Thakur, The Yogi project: software property checking via static analysis and testing, in: Proceedings of the 15th International Conference on Tools and Algorithms for the Construction and Analysis of Systems: Held as Part of the Joint European Conferences on Theory and Practice of Software, 2009, pp. 178-181.
68. J. Chen, S. MacDonald, Towards a better collaboration of static and dynamic analyses for testing concurrent programs, in: Proceedings of the 6th Workshop on Parallel and Distributed Systems: Testing, Analysis, and Debugging, 2008, pp. 1-9.
69. F. Elberzhager, R. Eschbach, Towards reduction of test effort: predicting defect-prone code classes and expected defect types based on inspection results, in: 36th Euromicro Software Engineering and Advanced Application, Proceedings of the Work in Progress Session, 2010.
70. A. Avancini, M. Ceccato, Towards security testing with taint analysis and genetic algorithms, in: Proceedings of the 2010 ICSE Workshop on Software Engineering for Secure Systems, 2010, pp. 65-71.
71. F. Elberzhager, R. Eschbach, J. Muench, Using inspection results for prioritizing test activities, in: 21st International Symposium on Software Reliability Engineering, Supplemental Proceedings, 2010, pp. 263-272. < http://inspection.iese.fhg.de/?p=documents >.
72. E. Duke V&V of flight and mission-critical software IEEE Software 6 3 1989 39 45
73. P. Runeson, C. Andersson, T. Thelin, A. Andrews, and T. Berling What do we know about defect detection methods? IEEE Software 23 3 2006 82 90
74. Zotero Tool. < http://www.zotero.org/ >.