Replications of software engineering experiments

Empirical Software Engineering

Volumn 19, Issue 2, 2014, Pages 267-276

  Carver, Jeffrey C ^a   Juristo, Natalia ^b,c   Baldassarre, Maria Teresa ^d   Vegas, Sira ^b  

^a University of Alabama   (United States)

^b UNIVERSIDAD POLITÉCNICA DE MADRID   (Spain)

^c UNIVERSITY OF OULU   (Finland)

^d UNIVERSITY OF BARI   (Italy)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER SOFTWARE;

EMPIRICAL SOFTWARE ENGINEERING; ENGINEERING COMMUNITY; EXPERIMENTAL REPLICATIONS; EXPERIMENTAL RESEARCH; REPLICATION PROCESS; SCIENTIFIC KNOWLEDGE; SCIENTIFIC VALUES; SOFTWARE ENGINEERING EXPERIMENTS;

SOFTWARE ENGINEERING;

EID: 84896394084     PISSN: 13823256     EISSN: 15737616     Source Type: Journal    
DOI: 10.1007/s10664-013-9290-8     Document Type: Review

References (20)

1. V Basili F Shull F Lanubile 1999 Building knowledge through families of experiments IEEE Trans Softw Eng 25 4 456 473 10.1109/32.799939
2. Brooks A, Daly J, Roper M, Wood M (1995) Replication of experimental results in software engineering. Tech. Rep. Technical Report, RR/95/193 [EFoCS-17-95]
3. A Brooks M Roper M Wood J Daly J Miller 2008 Replication's role in software engineering F Shull J Singer D Sjøberg (eds) Guide to advanced empirical software engineering Springer London 365 379 10.1007/978-1-84800-044- 5-14 Brooks A, Roper M, Wood M, Daly J, Miller J (2008) Replication's role in software engineering. In: Shull F, Singer J, Sjøberg D (eds) Guide to advanced empirical software engineering. Springer, London, pp 365-379
4. Campbell DT, Stanley JC (1963) Experimental and quasi-experimental designs for research
5. Carver JC (2010) Towards reporting guidelines for experimental replications: a proposal. In: RESER'2010: proceedings of the 1st international workshop on replication in empirical software engineering research
6. J Giles 2006 The trouble with replication Nature 442 344 347 10.1038/442344a
7. Gómez OS, Juristo N, Vegas S (2010a) Replication, reproduction and re-analysis: three ways for verifying experimental findings. In: RESER2010: proceedings of the 1st international workshop on replication in empirical software engineering research
8. Gómez OS, Juristo N, Vegas S (2010b) Replications types in experimental disciplines. In: Proceedings of the 4th ACM-IEEE international symposium on empirical software engineering and measurement. ACM, New York, pp 3:1-3:10
9. Jedlitschka A, Pfahl D (2005) Reporting guidelines for controlled experiments in software engineering. In: Proceedings of the 4th international symposium on empirical software engineering, pp 95-104
10. Juristo N, Vegas S (2009) Using differences among replications of software engineering experiments to gain knowledge. In: Proceedings of the 3rd international symposium on empirical software engineering and measurement. IEEE Computer Society, Washington, pp 356-366
11. B Kitchenham 2008 The role of replications in empirical software engineering-a word of warning Empir Softw Eng 13 2 219 221 10.1007/s10664-008- 9061-0
12. Krein JL, Knutson CD (2010) A case for replication: synthesizing research methodologies in software engineering. In: RESER2010: proceedings of the 1st international workshop on replication in empirical software engineering research
13. R Moonesinghe MJ Khoury ACJW Janssens 2007 Most published research findings are false but a little replication goes a long way PLoS Med 4 2 e28 10.1371/journal.pmed.0040028
14. S Schmidt 2009 Shall we really do it again? the powerful concept of replication is neglected in the social sciences Rev Gen Psychol 13 2 90 100 10.1037/a0015108
15. Shull F, Basili V, Carver J, Maldonado JC, Travassos GH, Mendonça M, Fabbri S (2002) Replicating software engineering experiments: addressing the tacit knowledge problem. In: Proceedings of the 1st international symposium on empirical software engineering. IEEE Computer Society, Washington, pp 7-16
16. FJ Shull JC Carver S Vegas N Juristo 2008 The role of replications in empirical software engineering Empir Softw Eng 13 2 211 218 10.1007/s10664-008- 9060-1
17. Silva FQ, Suassuna M, Frana ACC, Grubb AM, Gouveia TB, Monteiro CV, Santos IE (2012) Replication of empirical studies in software engineering research: a systematic mapping study. Empir Softw Eng 1-57
18. D Sjøberg J Hannay O Hansen V Kampenes A Karahasanovic NK Liborg A Rekdal 2005 A survey of controlled experiments in software engineering IEEE Trans Softw Eng 31 9 733 753 10.1109/TSE.2005.97
19. Vegas S, Juristo N, Moreno A, Solari M, Letelier P (2006) Analysis of the influence of communication between researchers on experiment replication. In: Proceedings of the 5th ACM/IEEE international symposium on empirical software engineering. ACM, New York, pp 28-37
20. Zannier C, Melnik G, Maurer F (2006) On the success of empirical studies in the international conference on software engineering. In: Proceedings of the 28th international conference on software engineering. ACM, New York, pp 341-350