The future of empirical methods in software engineering research

FoSE 2007: Future of Software Engineering

Volumn , Issue , 2007, Pages 358-378

  Sjøberg, Dag I K ^a   Dybå, Tore ^a,b   Jørgensen, Magne ^a  

^a SIMULA RESEARCH LABORATORY   (Norway)

^b SINTEF ICT   (Norway)

Author keywords

[No Author keywords available]

Indexed keywords

EDUCATION; INDUSTRIAL RESEARCH; KNOWLEDGE ENGINEERING; REQUIREMENTS ENGINEERING;

ACADEMIA; RESEARCH METHODS; SCIENTIFIC KNOWLEDGE;

SOFTWARE ENGINEERING;

EID: 34748911996     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/FOSE.2007.30     Document Type: Conference Paper

References (139)

1. Abdel-Hamid, T.K., Sengupta, K. and Ronan, D. Software project control: an experimental investigation of judgement with fallible information, IEEE Transactions on Software Engineering, 19(6):603-612, 1993
2. Anda, B.C.D., Benestad, H.C. and Hove, S.E., A Multiple-Case Study of Effort Estimation based on Use Case Points, In ISESE'2005. IEEE Computer Society, Noosa, Australia, Nov. 17-18, pp. 407-416, 2005
3. Arisholm, E. and Sjoberg, D.I.K. Evaluating the Effect of a Delegated versus Centralized Control Style on the Maintainability of Object-Oriented Software, IEEE Transactions on Software Engineering, 30(8): 521-534, 2004
4. Arisholm, E., Gallis, H.E., Dybå, T. and Sjøberg, D.I.K. Evaluating Pair Programming with Respect to System Complexity and Programmer Expertise, IEEE Transactions on Software Engineering, 33(2): 65-86, 2007
5. Arisholm, E., Sjøberg, D.I.K., Carelius G.J. and Lindsjorn, Y. A Web-based Support Environment for Software Engineering Experiments, Nordic Journal of Computing 9(4): 231-247, 2002
6. Avison, D., Lau, F., Myers, M. and Nielsen, P.A. Action Research, Communications of the ACM, 42(1): 94-97, 1999
7. Basili, V.R. Editorial. Empirical Software Engineering, 1(2), 1996
8. Basili, V.R. The Role of Experimentation in Software Engineering: Past, Current, and Future. 18th International Conference on Software Engineering (ICSE-18), Berlin, Germany, 25-29 March, pp. 442-449, 1996
9. Basili, V.R., McGarry, F.E., Pajerski, R. and Zelkowitz, M.V. Lessons learned from 25 years of process improvement: the rise and fall of the NASA Software Engineering laboratory. ICSE-24, pp. 69-79, 2002
10. Basili, V.R., Rombach, D., Schneider, K., Kitchenham, B., Pfahl, D. and Selby, R. Experimental Software Engineering Issues: Assessment and Future, Dagstuhl seminar, Germany, LNCS 4336, Springer-Verlag, 2007
11. Basili, V.R., Selby, R.W. and Hutchens, D.H. Experimentation in Software Engineering, IEEE Transactions on Software Engineering, 12(7): 733-743, 1986
12. Basili, V.R., Shull, F. and Lanubile, F. Building Knowledge through Families of Experiments, IEEE Transactions on Software Engineering, 25(4): 456-473, 1999
13. Basili, V.R., Zelkowitz, M., Sjøberg, D.I.K., Johnson, P. and Cowling, T. Protocols in the Use of Empirical Software Engineering Artifacts, Empirical Software Engineering, 2007 (in press)
14. Baskerville, R. and Wood-Harper, A.T. A Critical Perspective on Action Research as a Method for Information Systems Research, Journal of Information Technology, 11(3): 235-246, 1996
15. Baskerville, R. and Wood-Harper, A.T. Diversity in Information Systems Action Research Methods, European Journal of Information Systems, 7(2): 90-107, 1998
16. Benbasat, I. and Zmud, R.W., Empirical research in information systems: the practice of relevance, MIS Quarterly, 23(1): 3-16, 1999
17. Benbasat, I., Goldstein, D.K. and Mead, M. The Case Research Strategy in Studies of Information Systems, MIS Quarterly, 11(3): 369-386, 1987
18. Benestad, H.C., Arisholm, E. and Sjøberg, D.I.K. How to Recruit Professionals as Subjects in Software Engineering Experiments, IRIS'2005, 6-9 Aug., Kristiansand, Norway, 2005
19. Boehm, B., Rombach, H.D. and Zelkowitz, M.V. (eds.) Foundations of Empirical Software Engineering, The Legacy of Victor R. Basili, Springer-Verlag, 2005
20. Booch. G. Developing the future, Communications of the ACM, (44(3): 118-121, 2001
21. Brehmer, B. In One Word: Not from Experience, Acta Psychologica, 45(1-3): 223-241, 1980
22. Briand L. and Wolf A. (eds.) Future of Software Engineering, IEEE-CS Press, 2007
23. Brilliant, S.S. and Knight. J.C., Empirical Research in Software Engineering: A Workshop, Software Engineering Notes, 24(3): 45-52, 1999
24. Burkhardt, J.M., Detienne, F. and Wiedenbeck, S. Object-Oriented Program Comprehension: Effect of Expertise, Task and Phase, Empirical Software Engineering, 7(2): 115-156, 2002
25. Carroll, J. and Swatman P.A. Structured-Case: A methodological framework for building theory in IS research, European Conference on IS, Vienna, 3-5, July 2000
26. Christensen, L.B. Experimental Methodology, 10th ed. Allyn & Bacon, 2006
27. Cohen, B.P. Developing Sociological Knowledge: Theory and Method, 2nd Ed., Chicago: Nelson-Hall, 1989
28. Conradi, R., Dybå, T. Sjøberg, D.I.K. and Ulsund, T. Software Process Improvement: Results and Experience from the Field, Springer-Verlag, 2006
29. Conradi, R., Dybå, T. Sjøberg, D.I.K. and Ulsund, T., Lessons Learned and Recommendations from two Large Norwegian SPI Programmes, EWSPT'2003, Oquendo (ed.), Helsinki, Finland, Springer-Verlag, pp. 32-45, 2003
30. Cook, T.D. and Campbell, D.T. QuasiExperimentation: Design & Analysis Issues for Field Settings, Boston: Houghton Mifflin Company, 1979
31. Cooper, H. and Hedges, L.V. (eds.) Handbook of Research Synthesis, NY: Russell Sage Foundation, 1994
32. Cooper, H. Synthesizing Research (3rd Ed.), Thousand Oaks, CA: Sage, 1998
33. Dahl, O.J. and Nygaard, K. SIMULA: An ALGOLbased Simulation Language, Communications of the ACM, 9(9): 671-678, 1966
34. Davison R.M., Martinsons, M.G. and Kock, N. Principles of Canonical Action Research, Information Systems Journal, 14: 65-86, 2004
35. DeVellis, R.F. Scale Development: Theory and Applications(2nd Ed.), Newbury Park, Ca: Sage, 2003
36. Dixon-Woods, M., Agarwal, S., Jones, D., Young, B. and Sutton, A. Synthesising Qualitative and Quantitative Evidence: A Review of Possible Methods, Journal of Health Services Research & Policy, 10(1): 45-53, 2005
37. Dixon-Woods, M., Bonas, S., Booth, A., Jones, D.R., Miller, T., Sutton, A.J., Shaw, R.L., Smith, J.A. and Young, B. How can systematic reviews incorporate qualitative research? A critical perspective, Qualitative Research, 6(1): 27-44, 2006
38. Dybå, T. An Empirical Investigation of the Key Factors for Success in Software Process Improvement, IEEE Transactions on Software Engineering, 31(5): 410-424, 2005
39. Dybå, T. An Instrument for Measuring the Key Factors of Success in Software Process Improvement, Empirical Software Engineering, 5(4): 357-390, 2000
40. Dybå, T., Kampenes, V.B. and Sjøberg, D.I.K. A Systematic Review of Statistical Power in Software Engineering Experiments, Information and Software Technology, 48(8): 745-755, 2006
41. Dybå, T., Kitchenham, B.A. and Jorgensen, M. Evidence-Based Software Engineering for Practitioners, IEEE Software, 22(1): 58-65, 2005
42. Dybå, T., Moe, N.B. and Arisholm, E. Measuring Software Methodology Usage: Challenges of Conceptualization and Operationalization, ISESE'2005, Noosa Heads, Australia, 17-18 Nov., pp. 447-457, 2005
43. Egger, M., Smith, G.D. and Altman, D.G. Systematic Reviews in Health Care: Meta-analysis in Context (2nd Ed.), London: BMJ Publishing Group, 2001
44. Eiden, M. and Chisholm, R.F. Emerging Varieties of Action Research: Introduction to the Special Issue, Human Relations, 46(2): 121-142, 1993
45. Endres, A. and Rombach, D. A Handbook of Software and Systems Engineering. Empirical Observations, Laws and Theories. Fraunhofer IESE Series on Software Engineering. Pearson Education Limited, 2003
46. Fenton, N., Pfleeger, S.L. and Glass, R.L. Science and Substance: A Challenge to Software Engineers, IEEE Software, 11(4): 86-95, 1994
47. Fink, A. and Kosecoff, J. How to Conduct Surveys: A Step-By-Step Guide (3rd Ed.), Thousand Oaks, California: Sage Publications, 2005
48. Gerring, J. Case Study Research: Principles and Practices, New York: Cambridge Univ. Press, 2007
49. Glass, R.L. Facts and Fallacies of Software Engineering, Addison-Wesley, 2003
50. Glass, R.L. Pilot Studies: What, Why and How, Journal of Systems and Software, 36(1): 85-97, 1997
51. Glass, R.L., Vessey, I. and Ramesh, V. Research in Software Engineering: An Analysis of the Literature, Information and Software Technology, 44(8): 491-506, 2002
52. Glass, R.L. and Vessey, I. Contemporary ApplicationDomain Taxonomies. IEEE Software, 12(4): 63-76, 1995
53. Greenhalgh, T. How to Read a Paper (3rd Ed.), London: BMJ Publishing Group, 2006
54. Greenwood, D.J. and Levin, M. Introduction to Action Research: Social Research for Social Change (2nd Ed.), Thousand Oaks, California: Sage, 2006
55. Haig, B.D. An Abductive Theory of Scientific Method, Psychological Methods, 10(4): 317-388, 2005
56. Hannay, J., Sjøberg, D.I.K. and Dybå, T. A Systematic Review of Theory Use in Software Engineering Experiments, IEEE Transactions on Software Engineering, 33(2): 87-107, 2007
57. Hardy, M. and Bryman, A. Handbook of Data Analysis, London: Sage Publications, 2004
58. Harrison, W. Skinner Wasn't a Software Engineer, Editorial, IEEE Software, 22(3): 5-7, 2005
59. Hawker, S., Payne, S., Kerr, C., Hardey, M. and Powell, J. Appraising the Evidence: Reviewing Disparate Data Systematically, Qualitative Health Research, 12(9): 1284-1299, 2002
60. Herbsleb, D.J. and Mockus, A. Formulation and Preliminary Test of an Empirical Theory of Coordination in Software Engineering, ACM SIOSOFT Software Engineering Notes, 28(5): 138-147, 2003
61. Higgins J.P.T. and Green S. (eds.) Cochrane Handbook for Systematic Reviews of Interventions 4.2.6 [September 2006]. In The Cochrane Library, Issue 4, 2006. Chichester, UK: John Wiley & Sons, Ltd. 2006
62. Höfer, A. and Tichy, W.F. Status of Empirical Research in Software Engineering. In: Basili et al. (eds), Experimental Software Engineering Issues: Assessment and Future Directions, Springer-Verlag, LNCS 4336, 2007
63. Holt, N.E. A Systematic Review of Case Studies in Software Engineering, MSc thesis, Dep. of Informatics, Univ. of Oslo, 2006
64. Hove, S.E. and Anda, B.C.D. Experiences from Conducting Semi-Structured Interviews in Empirical Software Engineering Research, METRICS'2005, 19-22 Sep., Como, Italy. IEEE, pp. 1-10, 2005
65. Jørgensen, M. A Review of Studies on Expert Estimation of Software Development Effort, Journal of Systems and Software, 70(1-2): 37-60, 2004
66. Jørgensen, M. and Shepperd, M. A Systematic Review of Software Development Cost Estimation Studies, IEEE Transactions on Software Engineering, 33(1): 33-53, 2007
67. Jørgensen, M. and Sjøberg, D.I.K. Generalization and Theory-Building in Software Engineering Research, EASE'2004, IEE Proceedings, pp. 29-36, 2004
68. Jørgensen, M. Realism in Assessment of Effort Estimation Uncertainty: It Matters How You Ask. IEEE Transactions on Software Engineering, 30(4): 209-217, 2004
69. Jørgensen, M. Software Quality Measurement, Advances in Engineering Software, 30(12): 907-912, 1999
70. Jørgensen, M., Dybå, T. and Kitchenham, B.A. Teaching Evidence-Based Software Engineering to University Students, Proceedings of METRICS'2005, Como, Italy, 19-22 Sept. 2005
71. Juristo, N. and Moreno, A.M. Basics of Software Engineering Experimentation, Dordrecht, Kluwer Academic Publishers, 2001
72. Kahneman, D, and Tversky, A. (eds.), Choices, Values and Frames. New York: Cambridge University Press and the Russell Sage Foundation, 2000
73. Kampenes, V.B., Dybå, T., Hannay, J.E. and Sj̊berg, D.I.K. A Systematic Review of Effect Size in Software Engineering Experiments, to appear in Journal of Information and Software Technology, 2007
74. Kitchenham, B.A. Evaluating Software Engineering Methods and Tools, Parts 1 to 12, SIGSOFT Software Engineering Notes, Vols. 21-23, 1996/1998
75. Kitchenham, B.A. Procedures for Performing Systematic Reviews, Keele University, Technical Report TR/SE-0401 and NICTA Technical Report 0400011T.1. 2004
76. Kitchenham, B.A., Dybå, T. and Jorgensen, M. Evidence-Based Software Engineering, ICSE'2004, Edinburgh, Scotland, 23-28 May, pp. 273-281, 2004
77. Kitchenham, B.A., Pfleeger, S.L., Pickard, L.M., Jones, P.W., Hoaglin, D.C., El Emam, K. and Rosenberg, J. Preliminary Guidelines for Empirical Research in Software Engineering, IEEE Transactions on Software Engineering, 28(8): 721-734, 2002
78. Kitchenham, B.A., Pickard, L.M. and Pfleeger, S.L. Case Studies for Method and Tool Evaluation, IEEE Software, 12(4):52-62, 1995
79. Klein, H.K. and Myers, M.D. A Set of Principles for Conducting and Evaluating Interpretive Field Studies in IS, MIS Quarterly, 23(1): 67-93, 1999
80. Kock, N. (ed.) Information Systems Action Research: An Applied View of Emerging Concepts and Methods, Berlin: Springer-Verlag, 2007
81. Kraut, A.I. (ed.) Organizational Surveys: Tools for Assessment and Change, San Francisco: Jossey-Bass, 1996
82. Krosnick, J.A. Survey Research, Annual Review of Psychology, 50: 537-567. 1999
83. Land, L.P.W., Wong, B. and Jeffery, R. An Extension of the Behavioral Theory of Group Performance in Software Development Technical Reviews, Tenth Asia-Pacific SE Conference, 520-530, 2003
84. Lau, F. Toward a Framework for Action Research in Information Systems Studies, Information Technology & People, 12(2): 148-175, 1999
85. Lee, A.S. A Scientific Methodology for MIS Case Studies, MIS Quarterly, 13(1): 33-50, 1989
86. Lethbridge, T.C., Daz-Herrera, J., LeBlanc Jr., R.J., Thompson, J.B. Improving Software Practice through Education: Challenges and Future Trends. In [22]
87. Lethbridge, T.C., Sim, S.E. and Singer, J. Studying Software Engineers: Data Collection Techniques for Software Field Studies, Empirical Software Engineering, 10(3): 311-341, 2005
88. Lindblom, C.E. Alternatives to Validity. Some Thoughts Suggested by Campbell's Guidelines. Knowledge: Creation, Diffusion, Utilization, 8: 509-520, 1987
89. Lindsay, R.M. and Ehrenberg, A.S.C. The Design of Replicated Studies, The American Statistician, 47(3): 217-228, 1993
90. Lipsey, M.W. and Wilson, D.B. Practical MetaAnalysis, Thousand Oaks, CA: Sage, 2001
91. Lucas, J.W. Theory-testing, generalization, and the problem of external validity. Sociological Theory, 21: 236-253, 2003
92. Merton, R.K. Social theory and social structure, 3rd ed., The Free Press, New York, 1968
93. Miles M.B. and Huberman, A.M. Qualitative Data Analysis: An Expanded Source Book, Thousand Oaks, CA: Sage, 1994
94. Miller, J. Applying Meta-analytical Procedures to Software Engineering Experiments, Journal of Systems and Software, 54(1): 29-39, 2000
95. Montgomery, D.C. Design and Analysis of Experiments (6th Ed.), New Jersey: John Wiley & Sons, 2004
96. Mulrow, C. and Cook, D. (eds.) Systematic Reviews: Synthesis of Best Evidence for Health Care Decisions, Philadelphia, PA: Am. College of Physician, 1998
97. Neff, F.W. Survey Research: A Tool for Problem Diagnosis and Improvement in Organizations. In A.W. Gouldner and S.M. Miller (eds.), Applied Sociology, New York: Free Press, pp. 23-38, 1966
98. Neuman, W.L. Social Research Methods: Quantitative and Qualitative Approaches (6th Ed.), Boston: Allyn & Bacon, 2006
99. Noblit, G.W. and Hare, R.D. Meta-Ethnography: Synthesizing Qualitative Studies, Sage University series on Qualitative Research Methods, Vol. 11, Thousand Oaks, CA: Sage, 1988
100. Paterson, B.L., Thorne, S.E., Canam, C., and Jillings, C. Meta-Study of Qualitative Health Research: A Practical Guide to Meta-Analysis and Meta-Syn thesis, Thousand Oaks: Sage., 2001
101. Perry, D.E., Porter, A.A. and Votta, L.G. Empirical studies of Software Engineering: a roadmap, ICSE - Future of Software Engineering Track, pp. 345-355, 2000
102. Petticrew, M. and Roberts, H. Systematic Reviews in the Social Sciences: A Practical Guide, Oxford, UK: Blackwell, 2006
103. Pfleeger, S.L. Albert Einstein and Empirical Software Engineering, IEEE Computer, 32(10): 32-38, Oct. 1999
104. Pfleeger, S.L. Experimental Design and Analysis in Software Engineering, Parts 1 to 5, SIGSOFT Software Engineering Notes, Vols. 19-20, 1994/1995
105. Pickard, L.M., Kitchenham, B.A., Jones, P.W. Combining empirical results in Software Engineering, Information and Software Technology, 40(14): 811-821, 1998
106. Pinsonneault, A. and Kraemer, K.L. Survey Research Methodology in Management Information Systems: An Assessment, Journal of Management Information Systems, 10(2): 75-105, 1993
107. Popper, K. The Logic of Scientific Discovery, Hutchison, London, 1959
108. Rainer, A., Ciolkowski, M., Pfahl, D., Kitchenham, B., Morasca, S. and Müller, M.M., Travassos, G.H., Vegas, S. Teaching Empirical Methods to Undergraduate Students. In [10], pp. 158-162
109. Ramanujan, S., Scamell, R.W. and Shah, J.R. An Experimental Investigation of the Impact of Individual, Program, and Organizational Characteristics on Software Maintenance Effort, Journal of Systems and Software, 54(2): 137-157, 2000
110. Reason, P. and Bradbury, H. (eds.) Handbook of Action Research: Participative Inquiry and Practice, Thousand Oaks, California: Sage, 2001
111. Robson, C. Real World Research (2nd Ed.), Oxford: Blackwell Publishers, 2002
112. Rombach D. and Achatz, R. Research Collaborations between Industry and Academia in a Global World. In [22]
113. Rombach, D.H., Basili, V.R. and Selby, R.W. (eds.): Experimental Software Engineering Issues: Critical Assessment and Future Directions, Int. Workshop, Dagstuhl seminar, Germany, Sep. 14-18, 1992, LNCS 706 Springer-Verlag, 1993
114. Rosenthal, R. and DiMatteo, M.R. Meta-Analysis: Recent Developments in Quantitative Methods for Literature Reviews, Annual Review of Psychology, 52: 59-82, 2001
115. Sauer, C, Jeffery, D.R., Land, L. and Yetton, P. The Effectiveness of Software Development Technical Reviews: A Behaviorally Motivated Program of Research, IEEE Transactions on Software Engineering, 26(1): 1-14, 2000
116. Seaman, C. Qualitative Methods in Empirical Studies of Software Engineering, IEEE Transactions on Software Engineering, 25(4): 557-572, 1999
117. Sengupta, B., Chandra, S. and Sinha, V. A Research Agenda for Distributed Software Development, ICSE'2006, Beijing, pp. 731-740, 2006
118. Shadish, W.R., Cook, T.D. and Campbell, D.T. Experimental and Quasi-Experimental Designs for Generalized Causal Inference. Boston: Houghton Mifflin, 2002
119. Sjøberg, D. Use of Professionals in Experiments, Letter to Editor, IEEE Software, 22(5): 9-10, 2005
120. Sjøberg, D.I.K., Anda, B., Arisholm, E., Dybå, T., Jorgensen, M., Karahasanovic, A., Koren, E.F. and Vokac M. Conducting Realistic Experiments in Software Engineering, Proceedings ISESE'2002, Nara, Japan, 3-4 October, pp. 17-26, 2002
121. Sjøberg, D.I.K., Anda, B., Arisholm, E., Dybå, T., Jorgensen, M., Karahasanovic, A. and Vokac M. Challenges and Recommendations when Increasing the Realism of Controlled Software Engineering Experiments. In: Conradi and Wang (eds.) Empirical Methods and Studies in Software Engineering: Experiences from ESERNET, Berlin: Springer-Verlag LNCS 2765, pp. 24-38, 2003
122. Sjoberg, D.I.K., Dybå, T. Anda, B.C.D. and Hannay, J.E. Building Theories in Software Engineering. To appear in F. Shull, J. Singer, D.I.K. Sjøberg (eds.), Advanced Topics in Empirical Software Engineering, Springer-Verlag, 2007
123. Sjøberg, D.I.K., Hannay, J.E., Hansen, O., Kampenes, V.B., Karahasanović, A., Liborg, N.-K. and Rekdal, A.C. A Survey of Controlled Experiments in Software Engineering, IEEE Transactions on Software Engineering, 31(9): 733-753, 2005
124. Spector, P. Summated Rating Scale Construction: An Introduction, Sage University Paper series on Quantitative Applications in the Social Sciences, series no. 07-082, Newbury Park, California: Sage, 1992
125. Spencer, L., Ritchie, J., Lewis, J. and Dillon, L. Quality in Qualitative Evaluation: A Framework for Assessing Research Evidence, London: Government Chief Social Researcher's Office, 2003
126. Stake, R.E. The Art of Case Study Research, Thousand Oaks, California: Sage, 1995
127. Thorne, S., Jensen, L., Kearney, M.H., Noblit, G. and Sandelowski, M. Qualitative Metasynthesis: Reflections on Methodological Orientation and Ideological Agenda, Qualitative Health Research, 14(10): 1342-1365, 2004
128. Tichy, W.F. Hints for Reviewing Empirical Work in Software Engineering, Empirical Software Engineering, 5(4): 309-312, 2000
129. Tichy, W.F. Should computer scientist experiment more? 16 excuses to avoid experimentation. IEEE Computer, 31(5): 32-40, 1998
130. Tichy, W.F., Lukowicz, P., Prechelt, L. and Heinz, E.A. Experimental Evaluation in Computer Science: A Quantitative Study, Journal of Systems and Software, 28(1): 9-18, 1995
131. Torraco, R.J. and Holton, E.F. A Theorist's Toolbox, Human Resource Development Review, 1(1): 129-140, 2002
132. Weick, K.E. Theory Construction as Disciplined Imagination, Academy of Management Review, 14(4): 516-531, 1989
133. Wohlin, C., Runeson, P. Host, M., Ohlsson, M.C., Regnell, B. and Wesslén, A. Experimentation in Software Engineering: An Introduction, Boston: Kluwer Academic Publishers, 2000
134. Yin, R.K. Case Study Research: Design and Methods (3rd ed.), Thousand Oaks, CA: Sage, 2003
135. Yin, R.K., Case Study Research: Design and Methods, Sage Publications, CA., 1984
136. Zelkowitz, M.V. and Wallace, D. Experimental Models for Validating Technology, Theory and Practice of Object Systems, 31(5): 23-31, 1998
137. Zelkowitz, M.V. and Wallace, D. Experimental Validation in Software Engineering, Information and Software Technology, (39): 735-743, 1997
138. Zeller, A. The Future of Programming Environments: Integration, Synergy, and Assistance. In: [22]
139. Zendler, A. A Preliminary Software Engineering Theory as Investigated by Published Experiments, Empirical Software Engineering, 6(2): 161-180, 2001