A systematic review of systematic review process research in software engineering

Information and Software Technology

Volumn 55, Issue 12, 2013, Pages 2049-2075

  Kitchenham, Barbara ^a   Brereton, Pearl ^a  

^a KEELE UNIVERSITY   (United Kingdom)

Author keywords

Mapping study; Systematic literature review; Systematic review; Systematic review methodology

Indexed keywords

DIGITAL LIBRARIES;

EMPIRICAL STUDIES; LITERATURE SEARCH; MAPPING STUDIES; QUALITY ASSESSMENT; RECENT RESEARCHES; SYSTEMATIC LITERATURE REVIEW; SYSTEMATIC REVIEW; TEXTUAL ANALYSIS;

SOFTWARE ENGINEERING;

EID: 84885174213     PISSN: 09505849     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.infsof.2013.07.010     Document Type: Review

References (40)

1. Pearl Brereton, Barbara A. Kitchenham, David Budgen, Mark Turner, Mohamed Khalil, Lessons from applying the systematic literature review process within the software engineering domain, Journal of Systems and Software 80 (4) (2007) 571-583. (Pubitemid 46329126)
2. J. Biolchini, P.G. Mian, A.C.C. Natali, G.T. Travassos, Systematic Review in Software Engineering. Technical Report RT-ES 679-05. PESC, COPPE/UFRJ, 2005.
3. D. Budgen, M. Turner, P. Brereton, B. Kitchenham, Using mapping studies in software engineering, in: Proc. of PPIG'08. Lancaster University, UK, 2008, pp. 195-204.
4. Fabio Q.B. da Silva, André L.M. Santos, Sérgio Soares, A. CésarC. Franca, Cleviton V.F. Monteiro, Felipe Farias Maciel, Six years of systematic literature reviews in software engineering: an updated tertiary study, Information and Software Technology 53 (9) (2011) 899-913.
5. O. Dieste, A.G. Padua, Developing Search Strategies for Detecting Relevant Experiments for Systematic Reviews. ESEM 2007, 2007.
6. T. DybA, T. Dingsøyr, Empirical studies of agile software development: a systematic review, Information and Software Technology 50 (2007) 833-859.
7. Tore DybA, Barbara Kitchenham, Magne Jørgensen, Evidence-based software engineering for practitioners, IEEE Software 22 (1) (2005) 58-65. (Pubitemid 40714956)
8. K. Felizardo, S. MacDonell, E. Mendes, J.C. Maldonado, A systematic mapping on the use of visual data mining to support the conduct of systematic literature reviews, Journal of Systems and Software 7 (2) (2012) 450-461.
9. T. Foss, E. Stensrud, B. Kitchenham, I. Myrtveit, A Simulation study of the model evaluation criteria MMRE, IEEE Transactions on Software Engineering 29 (11) (2003) 985-995.
10. A. Jedlitschka, M. Ciolkowski, D. Pfahl, Reporting experiments in software engineering, in: F. Shull, J. Singer, D. Sjøberg (Eds.), Guide to Advances Empirical Software Engineering, Springer, 2008.
11. B. Kitchenham, Pearl Brereton, Zhi Li, David Budgen, Andrew Burn, Repeatability of Systematic Literature Reviews. EASE 2011, 2011.
12. Barbara Kitchenham, Rialette Pretorius, David Budgen, Pearl Brereton, Mark Turner, Mahmood Niazi, Stephen G. Linkman, Systematic literature reviews in software engineering -A tertiary study, Information &Software Technology 52 (8) (2010) 792-805.
13. B.A. Kitchenham, D.I.K. Sjoberg, P. Brereton, D. Budgen, T. Dyba, M. Host, D. Pfahl, P. Runeson, Can We Evaluate the Quality of Software Engineering Experiments? ESEM, 2010.
14. B. Kitchenham, Pearl Brereton, David Budgen, The Educational Value of Mapping Studies of Software Engineering Literature. ICSE 2010, 2010.
15. Barbara Kitchenham, Pearl Brereton, David Budgen, Mark Turner, John Bailey, Stephen G. Linkman, Systematic literature reviews in software engineering -A systematic literature review, Information &Software Technology 51 (1) (2009) 7-15.
16. B.A. Kitchenham, S. Charters, Guidelines for Performing Systematic Literature Reviews in Software Engineering, Technical Report EBSE-2007-01, School of Computer Science and Mathematics, Keele University, 2007.
17. B. Kitchenham, Procedures for Undertaking Systematic Reviews, Joint Technical Report, Computer Science Department, 2004, Keele University (TR/SE-0401) and National ICT Australia Ltd. (0400011T.1), 2004.
18. B. Kitchenham, Tore DybA, Magne Jørgensen, Evidence-based software engineering, in: Proceedings of the 26th International Conference on Software Engineering, (ICSE '04), IEEE Computer Society, Washington DC, USA, 2004, pp. 273-281. ISBN 0-7695-2163-0.
19. A.A. Lopes, P. Pinho, F.V. Paulovich, R. Minhim, Visual text mining using association rules, Computers &Graphics 31 (3) (2007) 316-326. (Pubitemid 46726585)
20. L. Major, T. Kyriacou, O.P. Brereton, Systematic literature review: teaching novices programming using robots, IET Seminar Digest, 2011.
21. S. MacDonell, M. Shepperd, B. Kitchenham, E. Mendes, How reliable are systematic reviews in empirical software engineering?, IEEE TSE 36 (5) (2010) 676-687
22. C. Marshall, P. Brereton, Tools to Support Systematic Literature Review in Software Engineering: A Mapping Study. Unpublished Manuscript, 2013.
23. I. Myrtveit, E. Stensrud, Validity and reliability of evaluation procedures in comparative studies of effort prediction, Empirical Software Engineering 17 (1-2) (2012) 18-22.
24. G.W. Noblit, R.D. Hare, Meta-Ethnography: Synthesizing Qualitative Studies, Sage, Thousand Oaks, 1988.
25. S. Olejnik, J. Algina, Generalized eta and omega squared statistic: measures of effect size for some common research designs, Psychological Methods 8 (4) (2003) 434-447. (Pubitemid 38061517)
26. K. Petersen, R. Feldt, M. Shahid, M. Mattsson, Systematic Mapping Studies in Software Engineering. EASE 2008, 2008.
27. A.J. Quigley, M. Postema, H. Schmidt, ReVis: Reverse Engineering by Clustering and Visual Object Classification, in: Proceedings Australian Software Engineering Conference, 2000. IEEE, 2000, pp. 119-125.
28. A. Rainer, S. Beecham, A Follow-Up Empirical Evaluation of Evidence Based Software Engineering by Undergraduate Students. EASE, 2008.
29. A. Rainer, T. Hall, N. Baddoo, A Preliminary Empirical Investigation of the Use of Evidence Based Software Engineering by Under-Graduate Student. EASE, 2006.
30. R. Rosenthal, M.R. DiMatteo, Meta-Analysis: recent developments in quantitative methods for literature reviews, Annual Review of Psychology 52 (2001) 59-82. (Pubitemid 33705567)
31. P. Runeson, M. Höst, Guidelines for conducting and reporting case study research in software engineering, Empirical Software Engineering 14 (2009) 131-164.
32. Mats Skoglund, Per Runeson, Reference-Based Search Strategies in Systematic Reviews. EASE 2009, 2009.
33. D.I.K. Sjøberg, J.E. Hannay, O. Hansen, V.B. Kampenes, A. Karahasanovic, N.K. Liborg, A.C. Rekdal, A survey of controlled experiments in software engineering, IEEE Transactions on Software Engineering 31 (9) (2005) 733-753. (Pubitemid 41555415)
34. M. Staples, M. Niazi, Experiences using systematic review guidelines, Journal of Systems and Software 80 (9) (2007) 1425-1437. (Pubitemid 47238406)
35. Mark Staples, Mahmood Niazi, Experiences Using Systematic Review Guidelines. EASE, 2006.
36. K. Schulz, I. Chalmer, R.J. Hayes, D.G. Altman, Empirical evidence of bias dimensions of methodological quality associated with estimates of treatment effects in controlled trials, JAMA 273 (1995) 408-412.
37. K. Thorlund, G. Imberger, B.C. Johnston, M. Walsh, T. Awad, et al., Evolution of heterogeneity (I2) estimates and their 95% confidence intervals in large metaanalyses, PLoS ONE 7 (7) (2012) e39471, http://dx.doi.org/10.1371/ journal.pone.0039471.
38. R. Wieringa, N. Maiden, N. Mead, C. Rolland, Requirements engineering paper classification and evaluation criteria: a proposal and a discussion, Requirements Engineering 11 (2006) 102-107. (Pubitemid 43118937)
39. P. Woodall, P. Brereton, Conducting a Systematic Literature Review from the Perspective of a Ph.D. Researcher. EASE, 2006.
40. June M. Verner, Jennifer Sampson, Vladimir Tosic, Nur Azzah Abu Bakar, Barbara Kitchenham, Guidelines for industrially-based multiple case studies in software engineering, RCIS 2009 (2009) 313-324