Replication data management: Needs and solutions - An initial evaluation of conceptual approaches for integrating heterogeneous replication study data

International Symposium on Empirical Software Engineering and Measurement

Volumn , Issue , 2013, Pages 233-242

  Biffl, Stefan ^a   Serral, Estefania ^a   Winkler, Dietmar ^a   Condori Fernandez, Nelly ^b   Dieste, Oscar ^c   Juristo, Natalia ^c,d  

^a VIENNA UNIVERSITY OF TECHNOLOGY   (Austria)

^b UNIVERSITAT POLITÈCNICA DE VALÈNCIA   (Spain)

^c UNIVERSIDAD POLITÉCNICA DE MADRID   (Spain)

^d UNIVERSITY OF OULU   (Finland)

Author keywords

Infrastructure for conducting empirical studies; replication of empirical studies; software knowledge management

Indexed keywords

CONCEPTUAL APPROACHES; DATA REPOSITORIES; ECOSYSTEM APPROACH; EMPIRICAL STUDIES; HETEROGENEOUS DATA SOURCES; LOCAL APPROACHES; MODEL VARIATION; REPLICATION STUDY;

ECOSYSTEMS; KNOWLEDGE MANAGEMENT; MODELS; SOFTWARE ENGINEERING;

DATA INTEGRATION;

EID: 84893255471     PISSN: 19493770     EISSN: 19493789     Source Type: Conference Proceeding    
DOI: 10.1109/ESEM.2013.60     Document Type: Conference Paper

References (45)

1. M. Ciolkowski, "What do we know about perspective-based reading? An approach for quantitative aggregation in software engineering," in Proceedings of the 2009 3rd International Symposium on Empirical Software Engineering and Measurement, 2009, pp. 133-144.
2. J. E. Hannay, T. Dybå, E. Arisholm, and D. I. K. Sjøberg, "The effectiveness of pair programming: A meta-Analysis," Information and Software Technology, vol. 51, no. 7, pp. 1110-1122, 2009.
3. C. Wohlin, P. Runeson, M. Höst, M. C. Ohlsson, B. Regnell, and A. Wesslén, "Experimentation in Software Engineering," Springer, 2012.
4. N. Paton, "Managing and sharing experimental data: standards, tools and pitfalls," Biochemical Society Transactions, vol. 36, pp. 33-36, 2008.
5. H. Do, S. Elbaum, and G. Rothermel, "Supporting controlled experimentation with testing techniques: An infrastructure and its potential impact," Empirical Software Engineering, vol. 10, no. 4, pp. 405-435, 2005.
6. E. Arisholm, D. I. K. Sjøberg, G. J. Carelius, and Y. Lindsjørn, "SESE an experiment support environment for evaluating software engineering technologies," in NW-PER2002 (Tenth Nordic Workshop on Programming and Software Development Tools and Techniques). Copenhagen, Denmark, 2002, pp. 81-98.
7. S. Biffl, M. Ciolkowski, and F. Shull, "A Family of Experiments to Investigate the Influence of Context on the Effect of Inspection Techniques," in Proceedings of the Empirical Assessment in Software Engineering, IEE, 2002.
8. D. Winkler, R. Varvaroi, G. Goluch, and S. Biffl, "An Empirical Study On Integrating Analytical Quality Assurance Into Pair Programming," in 5th ACM-IEEE International Symposium on Empirical Software Engineering, 2006, pp. 21-23.
9. R. Kazman, M. Klein, M. Barbacci, T. Longstaff, H. Lipson, and J. Carriere, "The architecture tradeoff analysis method," in Fourth IEEE International Conference on Engineering of Complex Computer Systems (ICECCS '98), 1998, pp. 68-78.
10. D. Dhungana, I. Groher, E. Schludermann, and S. Biffl, "Software Ecosystems vs. Natural Ecosystems: Learning from the Ingenious Mind of Nature," in Proceedings of the Second Workshop on Software Ecosystems, 2010, pp. 96-102.
11. V. R. Basili and R. W. Selby, "Comparing the effectiveness of software testing strategies," Software Engineering, IEEE Transactions on, no. 12, pp. 1278-1296, 1987.
12. E. Kamsties and C. Lott, "An empirical evaluation of three defectdetection techniques," in Proceedings of the Fifth European Software Engineering Conference, 1995, pp. 362-383.
13. S. T. Acuña and N. Juristo, "Assigning people to roles in software projects," Software: Practice and Experience, vol. 34, no. 7, pp. 675-696, 2004.
14. G. M. Marakas and J. J. Elam, "Semantic structuring in analyst acquisition and representation of facts in requirements analysis," Information Systems Research, vol. 9, no. 1, pp. 37-63, 1998.
15. N. Juristo, A. M. Moreno, and S. Vegas, "Reviewing 25 Years of Testing Technique Experiments," Empirical Software Engineering, vol. 9, no. 1/2, pp. 7-44, Mar. 2004.
16. N. Juristo and S. Vegas, "Using differences among replications of software engineering experiments to gain knowledge," in Proceedings of the 2009 3rd International Symposium on Empirical Software Engineering and Measurement, 2009, pp. 356-366.
17. O. Dieste and N. Juristo, "Systematic review and aggregation of empirical studies on elicitation techniques," IEEE Transactions on Software Engineering, vol. 37, no. 2, pp. 283-304, Mar. 2011.
18. N. Condori-Fernández and O. Pastor, "Re-Assessing the Intention to Use a Measurement Procedure based on COSMIC-FFP," ENSUR A, p. 63, 2006.
19. N. Condori-Fernández, S. Abrahão, and O. Pastor, "On the estimation of the functional size of software from requirements specifications," Journal of Computer Science and Technology, vol. 22, no. 3, pp. 358-370, 2007.
20. B. Marín, O. Pastor, and A. Abran, "Towards an accurate functional size measurement procedure for conceptual models in an MDA environment," Data &Knowledge Engineering, vol. 69, no. 5, pp. 472-490, 2010.
21. S. Abrahão and G. Poels, "A family of experiments to evaluate a functional size measurement procedure for Web applications," Journal of Systems and Software, vol. 82, no. 2, pp. 253-269, 2009.
22. N. Condori-Fernández and O. Pastor, "Analyzing the Applicability of a Theoretical Model in the Evaluation of Functional Size Measurement Procedures," in SEKE, 2007, pp. 736-739.
23. N. Condori-Fernández and O. Pastor, "Towards a Theoretical Model for Evaluating the Acceptance of Model-driven Measurement Procedures," in SEKE, 2008, pp. 22-25.
24. S. Biffl and M. Halling, "Managing Software Inspection Knowledge for Decision Support of Inspection Planing," in Managing Software Engineering Knowledge, Springer, 2003, pp. 231-249.
25. S. Biffl and W. Grossmann, "Evaluating the accuracy of defect estimation models based on inspection data from two inspection cycles," pp. 145-154, Jul. 2001.
26. S. Biffl, P. Grünbacher, and M. Halling, "A Family of Experiments to Investigate the Effects of Groupware for Software Inspection," Journal of Automated Software Engineering, vol. 13, no. 3, pp. 373-394, 2006.
27. M. Halling, S. Biffl, and P. Grunbacher, "An experiment family to investigate the defect detection effect of tool-support for requirements inspection," Proceedings 5th International Workshop on Enterprise Networking and Computing in Healthcare Industry IEEE Cat No03EX717, pp. 278-285, 2003.
28. T. Menzies, B. Caglayan, E. Kocaguneli, J. Krall, F. Peters, and B. Turhan, "The PROMISE Repository of empirical software engineering data," West Virginia University, Department of Computer Science, 2012. [Online]. Available: http://promisedata.googlecode.com.
29. H. Do, S. Elbaum, and G. Rothermel, "Software-Artifact infrastructure repository." [Online]. Available: http://sir.unl.edu/ content/sir.php. [Accessed: 12-Jan-2012].
30. M. G. Mendonca, J. C. Maldonado, M. C. F. de Oliveira, J. Carver, S. C. P. F. Fabbri, F. Shull, G. H. Travassos, E. N. Hohn, and V. R. Basili, "A framework for software engineering experimental replications," in 13th IEEE International Conference on Engineering of Complex Computer Systems (ICECCS 2008), 2008, pp. 203-212.
31. W. D., K. M., S. C., and B. S., "Investigating the Impact of Experience and Solo/Pair Programming on Coding Efficiency: Results and Experiences from Coding Contests," 14th XP Conf. 2013, 2013.
32. A. Lam and B. Boehm, "Experiences in developing and applying a software engineering technology testbed," Empirical Software Engineering, vol. 14, no. 5, pp. 579-601, 2008.
33. L. Hochstein, T. Nakamura, and F. Shull, "An Environment of Conducting Families of Software Engineering Experiments," Software Development, vol. 74, no. 8, pp. 175-200, 2007.
34. E. Arisholm and D. Sjøberg, "A web-based support environment for software engineering experiments," Nordic Journal of Computing, vol. 9, no. 3, pp. 231-247, 2002.
35. V. Basili, G. Caldiera, and H. Rombach, "Experience factory," Encyclopedia of software, vol. 1, pp. 469-476, 1994.
36. J. Travassos, G. H., dos Santos, P. S. M., Neto, P. G. M., &Biolchini, "An environment to support large scale experimentation in software engineering," In 13th IEEE International Conference on Engineering of Complex Computer Systems, 2008. ICECCS 2008., pp. 193-202, 2008.
37. D. Wang, W. Zhang, J. Chen, Y. Yang, and Q. Wang, "EXPRE," in Proceedings of the 2010 ACM-IEEE International Symposium on Empirical Software Engineering and Measurement-ESEM '10, 2010, p. 1.
38. B. Boehm and V. Basili, "The cebase framework for strategic software development and evolution," in Third International Workshop on Economics-Driven Software Engineering Research (EDSER-3 2001), 2001.
39. B. Hofmann and V. Wulf, "Building Communities among software engineers: the VISEK approach to intra-And inter-organizational learning," Advances in Learning Software Organizations, pp. 25-33, 2003.
40. A. Halevy, "Why Your Data Won't Mix: Semantic Heterogeneity," Queue, vol. 3, no. 8, pp. 50-58, 2005.
41. S. Bergamaschi, S. Castano, and M. Vincini, "Semantic Integration of Semistructured and Structured Data Sources," SIGMOD Record, vol. 28, no. 1, pp. 54-59, 1999.
42. A. Wiesner, J. Morbach, and W. Marquardt, "Information integration in chemical process engineering based on semantic technologies," Computers &Chemical Engineering, vol. 35, no. 4, pp. 708-692, 2011.
43. T. R. Gruber, "A Translation Approach to Portable Ontology Specifications," Knowledge Acquisition, vol. 5, no. 2, p. 199-220.
44. H. Wache, T. Voegele, and U. Visser, "Ontology-based integration of information-A survey of existing approaches," Proceedings of IJCAI-01 Workshop: Ontologies and Information Sharing, pp. 108-117, 2001.
45. T. Moser and S. Biffl, "Semantic Integration of Software and Systems Engineering Environments," IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews), vol. 42, no. 1, pp. 38-50, Jan. 2012.