Research synthesis in software engineering: A tertiary study

Information and Software Technology

Volumn 53, Issue 5, 2011, Pages 440-455

  Cruzes, Daniela S ^a   Dyb, Tore ^b  

^a NORWEGIAN UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Norway)

^b SINTEF   (Norway)

Author keywords

Empirical software engineering; Evidence based software engineering; Mixed methods; Qualitative methods; Systematic review

Indexed keywords

EMPIRICAL SOFTWARE ENGINEERING; EVIDENCE BASED SOFTWARE ENGINEERING; MIXED-METHODS; QUALITATIVE METHOD; SYSTEMATIC REVIEW;

RESEARCH;

SOFTWARE ENGINEERING;

EID: 79952446954     PISSN: 09505849     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.infsof.2011.01.004     Document Type: Conference Paper

References (56)

1. Anderson S, Allen P, Peckham S, Goodwin N. (2008) "Asking the right questions: scoping studies in the commissioning of research on the organisation and delivery of health services," Health Res Policy Syst. Jul 9; 6:7.
2. H. Arksey, and L. O'Malley Scoping studies: towards a methodological framework Int. J. Social Res. Methodol. 8 1 2005 19 32 (Pubitemid 40322704)
3. V. Braun, and V. Clarke Using thematic analysis in psychology Qual. Res. Psychol. 3 2006 77 101
4. CASP, Critical Appraisals Skills Programme, NSH, UK, 2006. < http://www.sph.nhs.uk/what-we-do/public-health-workforce/resources/ critical-appraisals-skills-programme >.
5. B.P. Cohen Developing Sociological Knowledge: Theory and Method second Ed. 1989 Nelson-Hall Chicago
6. J. Cohen Statistical Power Analysis for the Behavioral Sciences second ed. 1988 Laurence Erlbaum
7. H. Cooper, L.V. Hedges, J.C. Valentine, The Handbook of Research Synthesis and Meta-Analysis second ed. 2009 Russell Sage Foundation
8. J. Corbin, and A. Strauss Basics of Qualitative Research third ed. 2007 Sage
9. D.S. Cruzes, M.G. Mendona, V.R. Basili, F. Shull, M. Jino, Extracting Information from Experimental Software Engineering Papers, Proc. SCCC'07, 2007, pp. 105-114.
10. D.S. Cruzes, T. Dyb, Synthesizing Evidence in Software Engineering Research," Proceedings of the 4th International Symposium on Empirical Software Engineering and Measurement (ESEM 2010), Bolzano-Bozen, Italy, 16-17 September, 2010.
11. D.S. Cruzes, V.R. Basili, F. Shull, M. Jino, Using Context Distance Measurement to Analyze Results across Studies, Proc. ESEM'07, 2007, pp. 235-244.
12. K. Davies, N. Drey, and D. Gould What are scoping studies? A review of the nursing literature Int. J. Nurs. Stud. 46 2009 1386 1400
13. M. Dixon-Woods, S. Agarwal, D. Jones, B. Young, and A. Sutton Synthesising qualitative and quantitative evidence: a review of possible methods J. Health Ser. Res. Policy 10 1 2005 45 53
14. M. Dixon-Woods, A. Booth, and A. Sutton Synthesizing qualitative research: a review of published reports Qual. Res. 7 3 2007 375 422
15. T. Dyb Improvisation in small software organizations IEEE Soft. 17 5 2000 82 87
16. T. Dyb, T. Dingsøyr, Strength of Evidence in Systematic Reviews in Software Engineering, Proceedings of the 2nd International Symposium on Empirical Software Engineering and Measurement (ESEM'08), Kaiserslautern, Germany, 9-10 October, ACM Press, 2008, pp. 178-187.
17. T. Dyb, T. Dingsøyr, G.K. Hanssen, Applying Systematic Reviews to Diverse Study Types: An Experience Report, Proc ESEM'07, 2007, pp. 225-234.
18. T. Dyb, B.A. Kitchenham, and M. Jørgensen Evidence-based software engineering for practitioners IEEE Soft. 22 1 2005 58 65 (Pubitemid 40714956)
19. C.A. Estabrooks, P.A. Field, and J.M. Morse Aggregating qualitative findings: an approach to theory development Qual. Health Res. 4 4 1994 503 511
20. R. Franzosi Quantitative Narrative Analysis 2010 Sage
21. Glaser, and Strauss The Discovery of Grounded Theory: Strategies for Qualitative Research 1967 Aldine Transaction
22. G.V. Glass Primary, secondary, and meta-analysis of research Educ. Res. 5 10 1976 3 8
23. M. Hammersley, Systematic or Unsystematic, is that the Question? Some Reflections on the Science, Art and Politics of Reviewing Research Evidence, London: Health Development Agency Public Health Steering Group, 2002.
24. J.P.T. Higgins, S. Green (Eds.), Cochrane Handbook for Systematic Reviews of Interventions, Version 5.0.2, The Cochrane Collaboration, 2009. < http://www.cochrane-handbook.org > (updated September).
25. M. Jørgensen, T. Dyb, B. Kitchenham, Teaching Evidence-Based Software Engineering to University Students, Proceedings of the 11th International Software Metrics Symposium (Metrics 2005), Como, Italy, 19-22 September, 2005.
26. B.A. Kitchenham, S.L. Pfleeger, L.M. Pickard, P.W. Jones, D.C. Hoaglin, K.E. Emam, and J. Rosenberg Preliminary guidelines for empirical research in software engineering IEEE Trans. Softw. Eng. 28 8 2002 721 734
27. B. Kitchenham, O. Pearl Brereton, D. Budgen, M. Turner, J. Bailey, and S. Linkman Systematic literature reviews in software engineering - a systematic literature review Inf. Softw. Technol. 51 1 2009 7 15
28. B. Kitchenham, R. Pretorius, D. Budgen, O. Pearl Brereton, M. Turner, M. Niazi, and S. Linkman Systematic literature reviews in software engineering - a tertiary study Inf. Softw. Technol. 52 8 2010 792 805
29. B. Kitchenham, D.I. Sjøberg, O.P. Brereton, D. Budgen, T. Dyb, M. Höst, D. Pfahl, P. Runeson, Can we evaluate the quality of software engineering experiments?. In: Proceedings of the 2010 ACM-IEEE International Symposium on Empirical Software Engineering and Measurement (Bolzano-Bozen, Italy, September 16-17, 2010). ESEM '10. ACM, New York, NY, 2010, 1-8.
30. B.A. Kitchenham, Procedures for Performing Systematic Reviews, Keele University, Technical Report TR/SE-0401 and NICTA Technical Report 0400011T.1, 2004.
31. B.A. Kitchenham, S. Charters, Guidelines for performing Systematic Literature Reviews in Software Engineering, Version 2.3, Keele University, EBSE Technical Report, EBSE-2007-01, 2007.
32. B.A. Kitchenham, T. Dyb, M. Jørgensen, Evidence-based Software Engineering, Proc. ICSE'04, Edinburgh, Scotland, 23-28 May, 2004, pp. 273-281.
33. M.W. Lipsey, and D.B. Wilson Practical Meta - Analysis 2001 Sage
34. A.F. Long, and M. Godfrey An evaluation tool to assess the quality of qualitative research studies Int. J. Soc. Res. Meth. 7 2004 181 196 (Pubitemid 38482904)
35. N. Mays, C. Pope, and J. Popay Systematically reviewing qualitative and quantitative evidence to inform management and policy-making in the health field J. Health Serv. Res. Policy 10 Supplement 1 2005 6 20 (Pubitemid 40993881)
36. M.B. Miles, and A.M. Huberman Qualitative Data Analysis: An Expanded Source Book 1994 Sage
37. J. Miller Applying meta-analytical procedures to software engineering experiments J. Syst. Soft. 54 2000 29 39
38. C. Mulrow, D. Cook, Systematic Re-views: Synthesis of Best Evidence for Health Care Decisions 1998 Am. College of Physicians Philadelphia
39. G.W. Noblit, and R.D. Hare Meta-ethnography: Synthesizing Qualitative Studies 1988 Sage
40. R.T. Ogawa, and B. Malen Towards rigor in reviews of multivocal literatures: applying the exploratory case study method Rev. Educ. Res. 61 3 1991 265 286
41. B.L. Paterson, S.E. Thorne, C. Canam, and C. Jillings Meta-study of Qualitative Health Research: A Practical Guide to Meta-analysis and Meta-synthesis 2001 Sage
42. R. Pawson Evidence-based Policy: A Realist Perspective 2006 Sage
43. R. Pawson, T. Greenhalgh, G. Harvey, and K. Walshe Realist review - a new method of systematic review designed for complex policy interventions J. Health Serv. Res. Policy 10 1 2005 21 34 (Pubitemid 40993882)
44. C. Pope, N. Mays, and J. Popay Synthesizing Qualitative and Quantitative Health Evidence: A Guide to Methods 2007 Open University Press
45. C.C. Ragin The Comparative Method: Moving Beyond Qualitative and Quantitative Strategies 1987 University of California Press
46. C. Robson Real World Research second ed. 2002 Blackwell
47. M. Rodgers, A. Sowden, M. Petticrew, L. Arai, H. Roberts, N. Britten, and J. Popay Testing methodological guidance on the conduct of narrative synthesis in systematic reviews Evaluation 15 1 2009 49 74
48. R. Rosenthal, and D.M. DiMatteo Meta-analysis: recent development in quantitative methods for literature reviews Ann. Rev. Psychol. 52 2001 59 82 (Pubitemid 33705567)
49. P. Runeson, and M. Höst Guidelines for conducting and reporting case study research in software engineering Empirical Softw. Eng. 14 2 2009 131 164
50. M. Sandelowski, and J. Barroso Handbook for Synthesizing Qualitative Research 2007 Springer
51. M. Sandelowski, S. Docherty, and C. Emden Qualitative metasynthesis: issues techniques Res. Nurs. Health 20 4 1997 365 371
52. T.A. Schwandt Farewell to criteriology Qual. Inquiry 2 1 1996 58 72
53. D.I.K. Sjøberg, T. Dyb, M. Jørgensen, The Future of Empirical Methods in Software Engineering Research, Proc. FOSE'07, 2007, pp. 358-378.
54. L. Spencer, J. Ritchie, J. Lewis, and L. Dillon Quality in Qualitative Evaluation: A Framework for Assessing Research Evidence 2003 Cabinet Office London monograph online
55. D. Walsh, and S. Downe Appraising the quality of qualitative research Midwifery 22 2006 108 119 (Pubitemid 43728524)
56. R.K. Yin, and K.A. Heald Using the case survey method to analyze policy studies Admin. Sci. Quart. 20 1975 371 381