Replications types in experimental disciplines

ESEM 2010 - Proceedings of the 2010 ACM-IEEE International Symposium on Empirical Software Engineering and Measurement

Volumn , Issue , 2010, Pages

  Gómez, Omar S ^a   Juristo, Natalia ^a   Vegas, Sira ^a  

^a UNIVERSIDAD POLITÉCNICA DE MADRID   (Spain)

Author keywords

classifications of replications; experimental paradigm; experimental replication; software engineering; types of replications

Indexed keywords

CLASSIFICATIONS OF REPLICATIONS; EXPERIMENTAL PARADIGM; EXPERIMENTAL REPLICATION; KEY COMPONENT; SCIENTIFIC DISCIPLINE; SCIENTIFIC PARADIGM; TYPES OF REPLICATIONS;

ENGINEERING; SOFTWARE ENGINEERING;

EXPERIMENTS;

EID: 78149262767     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1852786.1852790     Document Type: Conference Paper

References (37)

1. J. P. F. Almqvist. Replication of controlled experiments in empirical software engineering - a survey. Master's thesis, Department of Computer Science, Faculty of Science, Lund University, Sweden, 2006.
2. H. M. Bahr, T. Caplow, and B. A. Chadwick. Middletown iii: Problems of replication, longitudinal measurement, and triangulation. Annu. Rev. Sociol., 9(1):243-264, Aug. 1983.
3. V. Basili, F. Shull, and F. Lanubile. Building knowledge through families of experiments. IEEE Transactions on Software Engineering, 25(4):456-473, Jul/Aug 1999.
4. A. Brooks, J. Daly, J. Miller, M. Roper, and M. Wood. Replication of experimental results in software engineering. Technical Report ISERN-96-10, Univ. of Strathclyde, Scotland, 1996.
5. D. T. Campbell and J. C. Stanley. Experimental and Quasi-Experimental Designs for Research. Houghton Mifflin Company, 1963.
6. T. Cook and D. Campbell. The design and conduct of quasi-experiments and true experiments in field settings. Rand McNally, Chicago, 1976.
7. R. Easley, C. Madden, and M. Dunn. Conducting marketing science: The role of replication in the research process. Journal of Business Research, 48(1):83-92, April 2000.
8. H. Evanschitzky and J. S. Armstrong. Replications of forecasting research. International Journal of Forecasting, In Press, Corrected Proof, 2009.
9. B. Finifter. The generation of confidence: Evaluating research findings by random subsample replication. Sociological Methodology, 4:112-175, 1972.
10. J. Hannay, T. Dybå, E. Arisholm, and D. Sjøberg. The effectiveness of pair programming: A meta-analysis. Information and Software Technology, 51(7):1110-1122, July 2009.
11. W. Hayes. Research synthesis in software engineering: A case for meta-analysis. In Proc. of the 6th International Symposium on Software Metrics (METRICS '99), page 143, Washington, DC, USA, 1999.
12. C. Hendrick. Replications, strict replications, and conceptual replications: Are they important? In J. W. Neuliep, editor, Handbook of Replication Studies in the Social and Behavioral Sciences. Sage, Newbury Park, California, 1990.
13. J. Hunter. The desperate need for replications. Journal of Consumer Research, 28(1):149-158, 2001.
14. B. H. Kantowitz, H. L. Roediger III, and D. G. Elmes. Experimental Psychology. Wadsworth Publishing, second ed. edition, 1984.
15. C. Kelly, L. Chase, and R. Tucker. Replication in experimental communication research: an analysis. Human Communication Research, 5(4):338-342, 1979.
16. B. Kitchenham. The role of replications in empirical software engineering-a word of warning. Empirical Softw. Engg., 13(2):219-221, 2008.
17. M. A. La Sorte. Replication as a verification technique in survey research: A paradigm. The Sociological Quarterly, 13(2):218-227, 1972.
18. R. Leone and R. Schultz. A study of marketing generalizations. The Journal of Marketing, 44(1):10-18, 1980.
19. R. M. Lindsay and A. S. C. Ehrenberg. The design of replicated studies. The American Statistician, 47(3):217-228, 1993.
20. J. Lung, J. Aranda, S. Easterbrook, and G. Wilson. On the difficulty of replicating human subjects studies in software engineering. In Proc. of the 30th international conference on Software engineering (ICSE '08), pages 191-200, New York, NY, USA, 2008.
21. D. T. Lykken. Statistical significance in psychological research. Psychol Bull, 70(3):151-159, 1968.
22. M. Mendonça, J. Maldonado, M. de Oliveira, J. Carver, S. Fabbri, F. Shull, G. Travassos, E. Hocombining double acute accenthn, and V. Basili. A framework for software engineering experimental replications. In Proc. of the 13th IEEE International Conference on Engineering of Complex Computer Systems (ICECCS '08), pages 203-212, Washington, DC, USA, 2008.
23. J. Miller. Can results from software engineering experiments be safely combined? In Proc. of the 6th International Symposium on Software Metrics (METRICS '99), page 152, Washington, DC, USA, 1999.
24. J. Miller. Applying meta-analytical procedures to software engineering experiments. J. Syst. Softw., 54(1):29-39, 2000.
25. J. Miller. Replicating software engineering experiments: a poisoned chalice or the holy grail. Information and Software Technology, 47(4):233-244, Mar. 2005.
26. J. Miller. Triangulation as a basis for knowledge discovery in software engineering. Empirical Softw. Engg., 13(2):223-228, 2008.
27. R. Mittelstaedt and T. Zorn. Econometric replication: Lessons from the experimental sciences. Quarterly Journal of Business & Economics, 23(1), 1984.
28. K. B. Monroe. Front matter. The Journal of Consumer Research, 19(1):i-iv, 1992.
29. H. Radder. Experimental reproducibility and the experimenters' regress. PSA: Proceedings of the Biennial Meeting of the Philosophy of Science Association, 1:63-73, 1992.
30. R. Rosenthal. Replication in behavioral research. Journal of Social Behavior and Personality, 4(4):1-30, 1990.
31. C. L. Sargent. The repeatability of significance and the significance of repeatability. European Journal of Parapsychology, 3:423-433, 1981.
32. S. Schmidt. Shall we really do it again? the powerful concept of replication is neglected in the social sciences. Review of General Psychology, 13(2):90-100, 2009.
33. K. L. Shewmaker and C. W. Berenda. Science and the problem of psi. Philosophy of Science, 29(2):195-203, 1962.
34. F. Shull, J. Carver, S. Vegas, and N. Juristo. The role of replications in empirical software engineering. Empirical Softw. Engg., 13(2):211-218, 2008.
35. K. Singh, S. H. Ang, and S. M. Leong. Increasing replication for knowledge accumulation in strategy research. Journal of Management, 29(4):533-549, 2003.
36. E. Tsang and K.-M. Kwan. Replication and theory development in organizational science: A critical realist perspective. The Academy of Management Review, 24(4):759-780, 1999.
37. M. H. Van IJzendoorn. A process model of replication studies: on the relation between different types of replication. Leiden University Library, 1994.