Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable?

Empirical Software Engineering

Volumn 20, Issue 6, 2015, Pages 1898-1917

  Octaviano, Fábio R ^a,d   Felizardo, Katia R ^b   Maldonado, José C ^c   Fabbri, Sandra C P F ^a  

^a FEDERAL UNIVERSITY OF SÃO CARLOS   (Brazil)

^b UNIVERSIDADE TECNOLÓGICA FEDERAL DO PARANÁ   (Brazil)

^c UNIVERSITY OF SÃO PAULO   (Brazil)

^d Federal Institute of São Paulo   (Brazil)

Author keywords

Evidence based software engineering (EBSE); Primary study selection activity; Revis tool; StArt tool; Systematic review (SR)

Indexed keywords

AUTOMATIC SELECTION; EVIDENCE BASED SOFTWARE ENGINEERINGS (EBSE); EXPLORATORY CASE STUDIES; PERCENTAGE ERROR; RESEARCH QUESTIONS; STUDY SELECTION ACTIVITIES; SYSTEMATIC LITERATURE REVIEW; SYSTEMATIC REVIEW;

SOFTWARE ENGINEERING;

EID: 84944354156     PISSN: 13823256     EISSN: 15737616     Source Type: Journal    
DOI: 10.1007/s10664-014-9342-8     Document Type: Article

References (24)

1. Babar MA, Zhang H (2010) Systematic literature reviews in software engineering: Preliminary results from interviews with researchers. In: Proc, ESEM’09, 1–10
2. Boell S, Cezec-Kecmanovic D (2011) “Are systematic reviews better, less biased and of higher quality?” ECIS 2011 Proceedings. Paper 223. http://aisel.aisnet.org/ecis2011/223
3. Brereton OP, Kitchenham BA, Budgen D, Turner M, Khalil M (2007) Lessons from applying the systematic literature review process within the software engineering domain. J Syst Softw 80(1):571–583
4. Carletta J (1996) Assessing agreement on classification tasks: the kappa statistic. Comput Linguis 22(2):249–254
5. Dieste O, Grimán A, Juristo N (2009) Developing search strategies for detecting relevant experiments. In: Proc. ESEM’09, 513–539
6. Dybå T, Kitchenham BA, Jorgensen M (2005) Evidence-based software engineering for practitioners. IEEE Softw 22(1):58–65
7. Dybå T, Dingsøyr T, Hanssen GK (2007) Applying systematic reviews to diverse study types: An experience report. In: Proc. ESEM’07, 225–234
8. Fabbri S, Hernandes E, Di Thommazo A, Belgamo A, Zamboni A, Silva C (2012) Managing literature reviews information through visualization. In: Proc. ICEIS’12, 36–45
9. Felizardo KR, Salleh N, Martins R, Mendes E, MacDonell S, Maldonado JC (2011) Using visual text mining to support the study selection activity in systematic literature reviews. In: Proc. ESEM’11, 1–10
10. Felizardo KR, Andery G, Paulovich F, Minghim R, Maldonado JC (2012) A visual analysis approach to validate the selection review of primary studies in systematic reviews. Inf Softw Technol 54(10):1079–1091
11. Kitchenham BA, Charters S (2007) Guidelines for performing systematic literature reviews in software engineering. EBSE Technical Report, Keele University and University of Durham, version 2.3
12. Kitchenham BA, Dybå T, Jørgensen M (2004) Evidence-based software engineering. In: Proc. ICSE’08, 273–281
13. Landis JR, Koch GG (1977) The measurement of observer agreement for categorical data. Biometrics 33:159–174
14. Malheiros V, Hohn E, Pinho R, Mendonca M, Maldonado JC (2007) A visual text mining approach for systematic reviews. In: Proc. ESEM’07, 245–254
15. Marshall C, Brereton P (2013) Tools to Support Systematic Literature Reviews in Software Engineering: A Mapping Study. In: Proc. ESEM’13, 296–299
16. Oates BJ, Capper G (2009) Using systematic reviews and evidence-based software engineering with masters students. In: Proc. EASE’09, 1–8
17. Paulovich FV, Minghim R (2008) HiPP: a novel hierarchical point placement strategy and its application to the exploration of document collections. IEEE Trans Vis Comput Graph 14(6):1229–1236
18. Petersen K, Ali NB (2011) Identifying strategies for study selection in systematic reviews and maps. In: Proc. ESEM’11, 351–354
19. Riaz M, Sulayman M, Salleh N, Mendes E (2010) Experiences conducting systematic reviews from novices’ perspective. In: Proc. EASE’10, 1–10
20. Shaw M, Clements P (2006) The golden age of software architecture: A comprehensive survey. Technical Report CMU-ISRI-06-101, Software Engineering Institute, Carnegie Mellon University
21. Shepperd M (2007) Software project economics: A roadmap. In: Proc. FOSE’07, IEEE Computer Society, Washington, DC, pp 304–315
22. Weka (2013) Available at http://www.cs.waikato.ac.nz/ml/weka/index.html. Last access on 30-March-2013
23. Wohlin C, Runeson P, Höst M, Ohlsson MC, Regnell B, Wesslén A (2000) Experimentation in Software Engineering: An Introduction. In: Kluwer Academic Publishers (ed), 1st edn. Boston, US, pp 63–74
24. Zhang H, Muhammad AB (2011) An empirical investigation of systematic reviews in software engineering. In: Proc. ESEM’11, 1–10