Six years of systematic literature reviews in software engineering: An updated tertiary study

Information and Software Technology

Volumn 53, Issue 9, 2011, Pages 899-913

  Da Silva, Fabio Q B ^a   Santos, André L M ^a   Soares, Sérgio ^a   Frana, A César C ^a   Monteiro, Cleviton V F ^a   MacIel, Felipe Farias ^a  

^a FEDERAL UNIVERSITY OF PERNAMBUCO   (Brazil)

Author keywords

Mapping studies; Software engineering; Systematic reviews; Tertiary studies

Indexed keywords

PUBLISHING; SOFTWARE ENGINEERING;

EVIDENCE BASED SOFTWARE ENGINEERING; MAPPING STUDIES; RESEARCH METHODS; SOFTWARE ENGINEERING PRACTICES; SYSTEMATIC LITERATURE REVIEW; SYSTEMATIC LITERATURE REVIEW (SLR); SYSTEMATIC REVIEW; TERTIARY STUDY;

ENGINEERING EDUCATION;

EID: 79958214321     PISSN: 09505849     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.infsof.2011.04.004     Document Type: Review

References (95)

1. H. Arksey, and L. ÓMalley Scoping studies: towards a methodological framework International Journal of Social Research Methodology 8 1 2005 19 32 (Pubitemid 40322704)
2. A. Abran, J. Moore, P. Bourque, and T. Dupuis Guide to software engineering body of knowledge IEEE Computer Society 2004 11 12
3. R.F. Barcelos, and G.H. Travassos Evaluation Approaches for Software Architectural Documents: A Systematic Review. IDEAS 2006 La Plata Argentina p. 14
4. J. Biolchini et al., Systematic review in software engineering. Technical Report RT-ES 679-05. PESC, COPPE/UFRJ, 2005.
5. Centre for Reviews and Dissemination, What are the Criteria for the Inclusion of Reviews on DARE?, 2007 (accessed 24.07.07, no longer working, use [6]).
6. Centre for Reviews and Dissemination, About DARE, 2010. (accessed 20.08.10).
7. F.Q.B. Da Silva Critical Appraisal of Systematic Reviews in Software Engineering: a Tertiary Study, ESEM'2010 2010 Bolzano-Bolzen Italy
8. T. Dyb Evidence-based software engineering for practitioners IEEE Software 22 1 2005 58 65
9. S.M. Easterbrook Selecting empirical methods for software engineering research F. Shull, J. Singer, D. Sjøberg, Guide to Advanced Empirical Software Engineering 2007 Springer
10. G. Glass Integrating findings: the meta-analysis of research Review of Research in Education 5 1977 351 379
11. T. Greenhalgh How to Read a Paper: The Basics of Evidence-based Medicine 2007 Blackwell Publishing London
12. R. Khan Reviews to Support Evidence-based Medicine: How to Review and Apply Findings of Healthcare Research 2003 Royal Society of Medicine Press Ltd.
13. B. Kitchenham Preliminary guidelines for empirical research in software engineering IEEE TSE 28 8 2002 721 734
14. B. Kitchenham et al., Evidence-based Software engineering, in: 26th International Conference on Software Engineering (ICSE), IEEE, Washington DC, 2004, pp. 273-281.
15. B.A. Kitchenham, Procedures for undertaking systematic reviews, Joint Technical Report, Computer Science Department, 2004, Keele University (TR/SE-0401) and National ICT Australia Ltd. (0400011T.1), 2004.
16. B. Kitchenham, S. Charters, Guidelines for performing systematic literature reviews in software engineering, Technical Report EBSE-2007-01, School of Computer Science and Mathematics, Keele University, 2007.
17. B.A. Kitchenham et al., Protocol for extending a tertiary study of systematic literature reviews in software engineering, EPIC Technical Report, EBSE-2008-006, 2008.
18. B. Kitchenham Systematic literature reviews in software engineering - a systematic literature review Information and Software Technology 51 2009 7 15
19. B. Kitchenham Literature reviews in software engineering - a tertiary study Information and Software Technology 52 8 2010 792 805
20. M. Jørgensen et al., Teaching evidence-based software engineering to university students, METRICS'05, 2005.
21. G.W. Noblit, and R.D. Hare Meta-Ethnography: Synthesizing Qualitative Studies 1988 Sage Publications London
22. H. Petersson Capture-recapture in software inspections after 10 years research - theory, evaluation and application JSS 72 2 2004 249 264
23. M. Petticrew, and H. Roberts Systematic Reviews in the Social Sciences 2006 Blackwell Publishing
24. A. Rainer, S. Beecham, 2008. Supplementary guidelines and assessment scheme for the use of evidence based software engineering, Technical Report CS-TR-469, University of Hertfordshire, Hatfield, UK.
25. D.L. Sackett Evidence-based medicine: what it is and what it isn't BMJ 312 1996 71 72
26. M. Sandelowski, and J. Barroso Handbook for Synthesizing Qualitative Research 2007 Springer Publishing Company New York
27. M. Shaw, and P. Clements The golden age of software architecture: a comprehensive survey IEEE Software 23 2 2006 31 39
28. Software Engineering 2004 Curricula Guidelines for Undergraduate Degree Programs in Software Engineering, Joint Task Force on Computing Curricula IEEE Computer Society Association for Computing Machinery, 2004.
29. S. Beecham Motivation in software engineering: a systematic literature review IST 50 9-10 2008 860 878
30. F.O. Bjornson, and T. Dingsoyr Knowledge management in software engineering: a systematic review of studied concepts, findings and research methods used Knowledge Management 50 11 2008 1055 1068
31. K. Cai, and D. Card An analysis of research topics in software engineering - 2006 JSS 81 6 2008 1051 1058 (Pubitemid 351522332)
32. F. Dong Software multi-project resource scheduling ICSP 2008 63 75
33. T. Dyb Empirical studies of agile software development: a systematic review IST 50 9-10 2008 833 859
34. B. Haugset, G.K. Hanssen, Automated Acceptance Testing: A Literature Review and an Industrial Case Study, in: Agile, IEEE, 2008, pp. 27-38.
35. A. Herrmann, M. Daneva, Requirements Prioritization Based on Benefit and Cost Prediction: An Agenda for Future Research, in: 16th RE, IEEE, 2008, pp. 125-134.
36. E. Insfran et al., A systematic review of usability evaluation in web development, in: Workshops on Web Information Systems Engineering, 2008, pp. 81-91.
37. M. Kalinowski et al., Towards a defect prevention based process improvement approach, in: 34th Euromicro, IEEE, 2008, pp. 199-206.
38. R. Pretorius, D. Budgen, A mapping study on empirical evidence related to the models and forms used in the uml, in: IEEE-ACM ESEM, IEEE, 2008.
39. D. Smite et al., Reporting empirical research in global software engineering: a classification scheme, in: ICGSE, IEEE, 2008, pp. 173-181.
40. L. Van Velsen User-centered evaluation of adaptive and adaptable systems: a literature review The Knowledge Engineering Review 23 03 2008 261 281
41. W. Afzal A systematic review of search-based testing for non-functional system properties IST 51 6 2009 957 976 Elsevier
42. S. Ali A systematic review of the application and empirical investigation of search-based test case generation IEEE TSE 99 2009 1 22
43. H.C. Benestad, Empirical assessment of cost factors and productivity during software evolution through the analysis of software change effort, Sciences - New York, 2009.
44. D. Blanes et al., 2009. Requirements engineering in the development of multi-agent systems: a systematic review, in: 10th IDEAL, pp. 510-517.
45. P. Brereton et al., Pair programming as a teaching tool: a student review of empirical studies, in: 22nd CSEE&T, 2009.
46. D. Budgen, C. Zhang, Preliminary reporting guidelines for experience papers, in: EASE, 2009, pp. 1-10.
47. R. Burrows et al., Coupling Metrics for Aspect-Oriented Programming: A Systematic Review of Maintainability Studies (Extended Version), ENASE, 2009.
48. J.a. Calvo-ManzanoVillalón State of the art for risk management in software acquisition ACM SIGSOFT Software Engineering Notes 34 4 2009 1
49. C. Catal, and B. Diri A systematic review of software fault prediction studies Expert Systems with Applications 36 4 2009 7346 7354
50. L. Chen et al., Variability management in software product lines: a systematic review, in: 13th SPLC, 2009, pp. 81-90.
51. L. Chen et al., A status report on the evaluation of variability management approaches, in: 13th EASE, 2009.
52. N. Condori-Fernandez et al., A systematic mapping study on empirical evaluation of software requirements specifications techniques, in: ESEM, IEEE, 2009, pp. 502-505.
53. B. Cornelissen A systematic survey of program comprehension through dynamic analysis IEEE TSE 35 5 2009 684 702
54. P.S. dos Santos et al., Action research use in software engineering: an initial survey, in: ESEM, IEEE, 2009, pp. 414-417.
55. J. Du et al., An analysis for understanding software security requirement methodologies, in: SSIRI, IEEE, 2009, pp. 141-149.
56. H. Edwards The repertory grid technique: its place in empirical software engineering research IST 51 4 2009 785 798
57. E. Engström A systematic review on regression test selection techniques IST 52 1 2010 14 30
58. T. Hall A systematic review of theory use in studies investigating the motivations of software engineers TOSEM 18 3 2009 (ACM)
59. J.E. Hannay The effectiveness of pair programming: a meta-analysis IST 51 7 2009 1110 1122
60. J. Hong Context-aware systems: a literature review and classification Expert Systems with Applications 36 4 2009 8509 8522
61. W. Hordijk et al., Harmfulness of code duplication - a structured review of the evidence, in: 13th EASE, 2009.
62. E. Hossain, and M.A. Babar Using scrum in global software development: a systematic literature review ICGSE 2009
63. M. Ivarsson, and T. Gorschek Technology transfer decision support in requirements engineering research: a systematic review of REj RE 2009 2009 155 175
64. M. Jiménez Challenges and improvements in distributed software development: a systematic review Advances in Software Engineering 2009 1 15
65. S.U. Khan et al., Critical barriers for offshore software development outsourcing vendors: a systematic literature review, in: 16th APSEC, IEEE, 2009, pp. 79-86.
66. S.U. Khan et al., Critical success factors for offshore software development outsourcing vendors: a systematic literature review, in: Fourth ICGSE (IEEE), 2009, pp. 207-216.
67. M. Khurum A systematic review of domain analysis solutions for product lines JSS 82 12 2009 1982 2003
68. B.P. Lamancha Software product line testing - a systematic review ICSOFT 2009 23 30
69. D. Liu et al., The role of software process simulation modeling in software risk management: a systematic review, in: Third ESEM (IEEE), 2009, pp. 302-311.
70. A. Lopez et al., Risks and safeguards for the requirements engineering process in global software development, in: Fourth ICGSE (IEEE), 2009, pp. 394-399.
71. F.J. Lucas A systematic review of UML model consistency management IST 51 12 2009 1631 1645
72. C. Mair, M. Shepperd, A literature review of expert problem solving using analogy, in: 13th EASE, 2009.
73. S.M. Mitchell A comparison of software cost, duration, and quality for waterfall vs. iterative and incremental development: A systematic review ESEM 2009
74. P. Mohagheghi et al., Definitions and approaches to model quality in model-based software development - a review of literature, IST 51(12), 1646-1669, 209.
75. S. Montagud Gathering current knowledge about quality evaluation in software product lines SPLC 2009 91 100
76. J. Nicolás On the generation of requirements specifications from software engineering models: a systematic literature review IST 51 9 2009 1291 1307
77. J.S. Persson Managing risks in distributed software projects: an integrative framework IEEE TOSEM 56 3 2009 508 532
78. Z. Racheva Value creation by agile projects: methodology or mystery? LNBIP 32 4 2009 141 155
79. A. Rainer et al., An assessment of published evaluations of requirements management tools, in: 13th EASE, p. 209.
80. M. Riaz, A systematic review of software maintainability prediction and metrics, in: 3rd ESEM, IEEE, 2009, pp. 367-377.
81. J. Savolainen, V. Myllarniemi, Layered architecture revisited - comparison of research and practice, in: WICSA/ECSA, IEEE, 2009, pp. 317-320.
82. K. Stol et al., The use of empirical methods in Open Source Software research: Facts, trends and future directions, in: Workshop on Emerging Trends in FLOSS Research and Development, IEEE, 2009, pp. 19-24.
83. G.S. Walia, and J.C. Carver A systematic literature review to identify and classify software requirement errors IST 51 7 2009 1087 1109
84. Z. Zakaria et al., Unit testing approaches for BPEL: a systematic review, in: 16th APSEC, IEEE, 2009, pp. 316-322.
85. E.D. de Souza Filho Evaluating domain design approaches using systematic review ECSA 2008 50 65
86. A.C. Dias-Neto, and G.H. Travassos Model-based testing approaches selection for software projects IST 51 11 2009 1487 1504
87. T. Ebling et al., A systematic literature review of requirements engineering in distributed software development environments, in: 11th ICEIS, 2009, pp. 363-366.
88. Q. Gu Exploring service-oriented system engineering challenges: a systematic literature review Service Oriented Computing and Applications 3 3 2009 171 188
89. A.S. Jadhav Evaluating and selecting software packages: a review IST 51 3 2009 555 563
90. V.B. Kampenes A systematic review of quasi-experiments in software engineering IST 51 1 2008 71 82
91. A. Trendowicz Factors influencing software development productivity - state-of-the-art and industrial experiences Advances in Computers 77 09 2009 185 241
92. M.V. Zelkowitz An update to experimental models for validating computer technology JSS 82 3 2009 373 376
93. H. Sharp Models of motivation in software engineering IST 51 1 2009 219 233
94. R. Prikladnicki et al., Patterns of distributed software development evolution: a systematic review of the literature, in: 12th EASE, 2008.
95. M. Khurum et al., Systematic review of solutions proposed for product line economics, in: 2nd MESPUL, 2008, pp. 386-393.