Design science methodology: For information systems and software engineering

Design Science Methodology: For Information Systems and Software Engineering

Volumn , Issue , 2014, Pages 1-332

  Wieringa, Roel J ^a  

^a UNIVERSITY OF TWENTE   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

INFORMATION SYSTEMS; PRODUCT DESIGN; SOFTWARE ENGINEERING;

DESIGN PROCESS; DESIGN SCIENCE; DESIGN SCIENCE METHODOLOGIES; IN CONTEXTS; KEY FEATURE; SYSTEMS AND SOFTWARE;

DESIGN;

EID: 84956782190     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1007/978-3-662-43839-8     Document Type: Book

References (343)

1. N. Cartwright, How the Laws of Physics Lie (Oxford University Press, Oxford, 1983)
2. H. Heerkens, A. van Winden, Geen Probleem: Een Aanpak voor Alle Bedrijfskundige Vragen en Mysteries (Van Winden Communicatie, Utrecht, The Netherlands, 2012)
3. A.R. Hevner, S.T. March, J. Park, S. Ram, Design science in information system research. MIS Quart. 28(1), 75-105 (2004)
4. R. Laymon, Applying idealized scientific theories to engineering. Synthese 81, 353-371 (1989)
5. R. Laymon, Experimentation and the legitimacy of idealization. Philos. Stud. 77, 353-375 (1995)
6. E.T. Layton, American ideologies of science and engineering. Technol. Cult. 17, 688-701 (1976)
7. E. McMullin, Galilean idealization. Stud. Hist. Philos. Sci. 16(3), 247-273 (1985)
8. J. Noltes, Data location compliance in cloud computing. Master’s thesis, Faculty of Electrical Engineering, Mathematics and Computer Science, University of Twente, August 2011. http://essay.utwente.nl/61042/
9. W.G. Vincenti, What Engineers Know and How They Know It. Analytical Studies from Aeronautical History (Johns Hopkins, Baltimore, 1990)
10. J.D. Vrielink, Phased array processing: direction of arrival estimation on reconfigurable hardware. Master’s thesis, Faculty of Electrical Engineering, Mathematics and Computer Science, University of Twente, January 2009. http://essay.utwente.nl/62065/
11. R.J. Wieringa, Design science as nested problem solving, in Proceedings of the 4th International Conference on Design Science Research in Information Systems and Technology, Philadelphia (ACM, New York, 2009), pp. 1-12
12. R.J. Wieringa, Relevance and problem choice in design science, in Global Perspectives on Design Science Research (DESRIST). 5th International Conference, St. Gallen, Lecture Notes in Computer Science, vol. 6105 (Springer, Heidelberg, 2010), pp. 61-76
13. Z. Racheva, M. Daneva, A. Herrmann, K. Sikkel, R.J. Wieringa, Do we know enough about requirements prioritization in agile projects: insights from a case study, in 18th International IEEE Requirements Engineering Conference, Sydney (IEEE Computer Society, Los Alamitos, October 2010), pp. 147-156
14. A.Water Mors, The World according to MARP. Ph.D. thesis, Delft University of Technology, March 2010. http://www.st.ewi.tudelft.nl/~adriaan/pubs/terMorsPhDthesis.pdf
15. R.N. Anthony, Planning and Control Systems: A Framework for Analysis (Harvard University Graduate School of Business Administration, Boston, 1965)
16. B.L. Archer, The structure of the design process, in Design Methods in Architecture, ed. By G. Broadbent, A. Ward (Lund Humphries, London, 1969), pp. 76-102
17. N. Cross, Engineering Design Methods: Strategies for Product Design, 2nd edn. (Wiley, Hoboken, 1994)
18. T. Gorschek, C. Wohlin, P. Garre, S. Larsson, A model for technology transfer in practice. IEEE Softw. 23(6), 88-95 (2006)
19. A.D. Hall, A Methodology for Systems Engineering (Van Nostrand, New York, 1962)
20. J. C. Jones, Design Methods: Seeds of Human Futures (Wiley, New York, 1970)
21. R.A. MacKenzie, The management process in 3-D, in Software Engineering Project Management, ed. by R.H. Thayer (IEEE Computer Science Press, Los Alamitos, 1988), pp. 11-14. First appeared in Harvard Business Review, November/December 1969
22. G. Pahl, W. Beitz, Konstruktionslehre. Handbuch für Studium und Praxis (Springer, Heidelberg, 1986)
23. K. Peffers, T. Tuunanen, M.A. Rothenberger, S. Chatterjee, A design science research methodology for information systems research. J. Manag. Inf. Syst. 24(3), 45-77 (2007-2008)
24. N.F.M. Roozenburg, J. Eekels, Product Design: Fundamentals and Methods (Wiley, Hoboken, 1995)
25. A. Wter Mors, The World According to MARP. Ph.D. thesis, Delft University of Technology, March 2010. http://www.st.ewi.tudelft.nl/~adriaan/pubs/terMorsPhDthesis.pdf
26. PJ. Van Strien, Towards a methodology of psychological practice: the regulative cycle. Theory Psychol. 7(5), 683-700 (1997)
27. R. J. Wieringa, Requirements Engineering: Frameworks for Understanding (Wiley, Hoboken, 1996). Also available at http://www.ewi.utwente.nl/~roelw/REFU/all.pdf
28. I. Alexander, A taxonomy of stakeholders: Human roles in systems development. Int. J. Technol. Human Interact. 1(1), 23-59 (2005)
29. M.I. Bossworth, Solution Selling: Creating Buyers in Difficult Markets (Irwin, Burr Ridge, 1995)
30. P. Clements, F. Bachmann, L. Bass, D. Garlan, J. Ivers, R. Little, P. Merson, R. Nord, J. Stafford, Documenting Software Architectures: Views and Beyond, 2nd edn. (Prentice-Hall, Upper Saddle River, 2010)
31. L. T.W. Agner, I.W. Soares, P.C. Stadzisz, and J.M. Simao, A Brazilian survey on UML and model-driven practices for embedded software development. J. Syst. Softw. 86(4), 997-1005 (2013)
32. J. Aranda, S.M. Easterbrook, G. Wilson, Requirements in the wild: how small companies do it, in Proceedings of the 15th IEEE International Requirements Engineering Conference (RE 2007). (Computer Science Press, New York, 2007), pp. 39-48
33. E. Babbie, The Practice of Social Research, 11th edn. (Thomson Wadsworth, Belmont, 2007)
34. M. Denscombe, The Good Research Guide For Small-Scale Social Research Projects, 4th edn. (Open University Press, Maidenhead, 2010)
35. J.E. Hannay, A. Arisholm, H. Engvik, D.I.K. Sjpberg, Effects of personality on pair programming. IEEE Trans. Softw. Eng. 36(1), 61-80 (2010)
36. M.D. Myers, A disaster for everyone to see: An interpretative analysis of a failed IS project. Accounting Manag. Inf. Technol. 4(4), 185-201 (1994)
37. J. Noltes, Data location compliance in cloud computing. Master’s thesis, Faculty of Electrical Engineering, Mathematics and Computer Science, University of Twente, August 2011. http://essay.utwente.nl/61042/
38. Z. Racheva, M. Daneva, A. Herrmann, K. Sikkel, R.J. Wieringa, Do we know enough about requirements prioritization in agile projects: insights from a case study, in 18th International IEEE Requirements Engineering Conference, Sydney, October 2010 (IEEE Computer Society, Los Alamitos, 2010), pages 147-156
39. C. Robson, Real World Research, 2nd edn. (Blackwell, Oxford, 2002)
40. J. Schalken, Empirical investigations of software process improvement. Ph.D. thesis, Vrije Universiteit, Amsterdam, 2007. http://www.cs.vu.nl/en/research/Dissertations-1995-now/index.asp
41. D. I.K. Sjpberg, B. Anda1, E. Arisholm1, T. Dyba, M. J0rgensen1, A. Karahasanovicacutel, M. Vokaccaron, Challenges and recommendations when increasing the realism of controlled software engineering experiments, in Empirical Methods and Studies in Software Engineering, ed. by R. Conradi, A.I. Wang, LNCS, vol. 2765 (Springer, New York, 2003), pp. 24-38
42. C. Terwellen, Evaluating the behavior of embedded control software - using a modular software-in-the-loop simulation environment and a domain specific modeling language for plant modeling. Master’s thesis, Faculty of Electrical Engineering, Mathematics and Computer Science, University of Twente, November 2012. http://essay.utwente.nl/62824/
43. J.D. Vrielink, Phased array processing: Direction of arrival estimation on reconfigurable hardware. Master’s thesis, Faculty of Electrical Engineering, Mathematics and Computer Science, University of Twente, January 2009. http://essay.utwente.nl/62065/
44. D.C. Gause, G.M. Weinberg, Exploring Requirements: Quality Before Design (Dorset House, New York, 1989)
45. C.A. Gunter, E.L. Gunter, M.A. Jackson, P. Zave, A reference model for requirements and specifications. IEEE Softw. 17(3), 37-43 (2000)
46. J. Hall, L. Rapanotti, Beauty in software engineering. Computer 46(2), 85-87 (2013)
47. ISO/IEC JTC1/SC7/WG6, ISO/IEC 9126-1 Information technology - Software Quality Characteristics and Metrics - Quality Characteristics and subcharacteristics. International Organization for Standardization, June 9, 1995
48. M.A. Jackson, Software Requirements and Specifications: A Lexicon of Practice, Principles and Prejudices (Addison-Wesley, Boston, 1995)
49. M.A. Jackson, Problem Frames: Analysing and Structuring Software Development Problems (Addison-Wesley, Boston, 2000)
50. S. Lauesen, Software Requirements: Styles and Techniques (Addison-Wesley, Boston, 2002)
51. R.J. Wieringa, Design Methods for Reactive Systems: Yourdon, Statemate and the UML (Morgan Kaufmann, Burlington, 2003)
52. I. Alexander, L. Beus-Dukic, Discovering Requirements: How to Specify Products and Services (Wiley, Hoboken, 2009)
53. L. Apostel, Towards a formal study of models in the non-formal sciences, in The Concept and Role of the Model in the Mathematical and the Natural and Social Sciences, ed. By H. Freudenthal (Reidel, Dordrecht, 1961), pp. 1-37
54. W. Engelsman, R.J. Wieringa, Goal-oriented requirements engineering and enterprise architecture: Two case studies and some lessons learned, in Requirements Engineering: Foundation for Software Quality (REFSQ 2012), Essen, Germany. Lecture Notes in Computer Science, vol. 7195 (Springer, Heidelberg, 2012), pp. 306-320
55. R.L. Glass, V. Ramesh, I. Vessey, An analysis of research in the computing disciplines. Commun. ACM 47(6), 89-94 (2004)
56. R. L. Glass, I. Vessey, V. Ramesh, Research in software engineering: an empirical study. Technical Report TR105-1, Information Systems Department, Indiana University, September 2001
57. T. Gorschek, C. Wohlin, P. Garre, S. Larsson, A model for technology transfer in practice. IEEE Softw. 23(6), 88-95 (2006)
58. M. A. Jackson, Problem Frames: Analysing and Structuring Software Development Problems (Addison-Wesley, Boston, 2000)
59. A. Kaplan, The Conduct of Inquiry. Methodology for Behavioral Science (Transaction Publishers, Piscataway, 1998); First edition 1964 by Chandler Publishers
60. L. P.W. Land, C. Sauer, R. Jeffrey, The use of procedural roles in code inspections: An experimental study. Empir. Softw. Eng. 5(1), 11-34 (2000)
61. S. Lauesen, Software Requirements: Styles and Techniques (Addison-Wesley, Reading, 2002)
62. M. S. Morgan, M. Morrison, Models as mediating instruments, in Models as Mediators. Perspectives on Natural and Social Science, ed. by M.S. Morgan, M. Morrison (Cambridge university Press, Cambridge, 1999)
63. R. Müller, The notion of a model: A historical overview, in Philosophy of Technology and Engineering Sciences, ed. by A. Meijers (Elsevier, Amsterdam, 2009), pp. 637-664
64. L. Prechelt, B. Unger-Lamprecht, M. Philippsen, W.F. Tichy, Two controlled experiments assessing the usefulness of design pattern documentation in program maintenance. IEEE Trans. Softw. Eng. 28(6), 595-606 (2002)
65. J. D. Vrielink, Phased array processing: Direction of arrival estimation on reconfigurable hardware. Master’s thesis, Faculty of Electrical Engineering, Mathematics and Computer Science, University of Twente, January 2009. http://essay.utwente.nl/62065/
66. R. Wieringa, Empirical research methods for technology validation: Scaling up to practice. J. Syst. Softw. (2013). http://dx.doi.org/10.1016/j.jss.2013.11.1097
67. P. Willner, Methods for assessing the validity of animal models of human psychopathology, in Animal Models in Psychiatry I, ed. by A. Boultin, G. Baker, M. Martin-Iverson. Neuromethods, vol.18 (The Humana Press, New York, 1991), pp. 1-23
68. M. V. Zelkowitz, D. Wallace, Experimental models for validating technology. Computer 31(5), 23-31 (1998)
69. W. Bechtel, A. Abrahamsen, Explanation: a mechanistic alternative. Stud. Hist. Philos. Biol. Biomed. Sci. 36, 421-441 (2005)
70. N. Bettenburg, A.E. Hassan, Studying the impact of social interactions on software quality. Empir. Softw. Eng. 18(2), 375-431 (2013)
71. A. Borgida, V. Chaudhri, P. Giorgini, E. Yu, Conceptual Modelling: Foundations and Applications (Springer, Heidelberg, 2009)
72. P. Clements, F. Bachmann, L. Bass, D. Garlan, J. Ivers, R. Little, P Merson, R. Nord, J. Stafford, Documenting Software Architectures: Views and Beyond, 2nd edn. (Addison-Wesley, Boston, 2010)
73. E.J. Dijksterhuis, The Mechanization of the World Picture (Oxford University Press, Oxford, 1961). Transl. C. Dikshoorn
74. W. Engelsman, R.J. Wieringa, Goal-oriented requirements engineering and enterprise architecture: Two case studies and some lessons learned, in Requirements Engineering: Foundation for Software Quality (REFSQ 2012), Essen, Germany. Lecture Notes in Computer Science, vol. 7195 (Springer, Heidelberg, 2012), pp. 306-320
75. D. Freedman, R. Pisani, R. Purves, Statistics, 4th edn. (Norton & Company, New York, 2007)
76. S. Gordon, History and Philosophy of Social Science (Routledge, London, 1992)
77. C. Hildebrand, G. Häubl, A. Herrmann, J.R. Landwher, When social media can be bad for you: Community feedback stifles consumer creativity and reduces satisfaction with self-designed products. Inf. Syst. Res. 24(1), 14-29 (2013)
78. C. Hofmeister, R. Nord, D. Soni, Applied Software Architecture (Addison-Wesley, Boston, 2000)
79. T. Huynh, J. Miller, An empirical investigation into open source web applications’ implementation vulnerabilities. Empir. Softw. Eng. 15(5), 556-576 (2010)
80. M. A. Jackson, Problem Frames: Analysing and Structuring Software Development Problems (Addison-Wesley, Boston, 2000)
81. R. Kaschek, L. Delcambre (eds.), The Evolution of Conceptual Modeling. Lecture Notes in Computer Science, vol. 6520 (Springer, Heidelberg, 2011)
82. Z. Li, N.H. Madhavji, S.S. Murtaza, M. Gittens, A.V. Miranskyy, D. Godwin, E. Cialini, Characteristics of multiple-component defects and architectural hotspots: A large system case study. Empir. Softw. Eng. 16, 667-702 (2011)
83. P. Machamer, L. Darden, C.F. Craver, Thinking about mechanisms. Philos. Sci. 67, 1-25 (2000)
84. R. Makkreel, Wilhem Dilthey, in The Stanford Encyclopedia of Philosophy, ed. by E.N. Zalta. Summer 2012 Edition (2012)
85. G. Morgan, Images of Organization (Sage Publications, Thousand Oaks, 1986)
86. A. Wter Mors, The World According to MARP. PhD thesis, Delft University of Technology, 2010. a href="http://www.st.ewi.tudelft.nl/$/sim$adriaan/pubs/terMorsPhDthesis.pdf">http://www.st.ewi.tudelft.nl/$\sim$adriaan/pubs/terMorsPhDthesis.pdf/a>
87. A. Olivé. Conceptual Modeling of Information Systems (Springer, Heidelberg, 2007)
88. R. Poli, J. Seibt, M. Healy, A. Kameas (eds.), Theory and Applications of Ontology. Computer Applications, vol. 2 (Springer, Heidelberg, 2011)
89. Z. Racheva, M. Daneva, A. Herrmann, K. Sikkel, R.J. Wieringa, Do we know enough about requirements prioritization in agile projects: Insights from a case study, in 18th International IEEE Requirements Engineering Conference, Sydney (IEEE Computer Society, Los Alamitos, 2010), pp. 147-156
90. N. F.M. Roozenburg, J. Eekels, Product Design: Fundamentals and Methods (Wiley, Boston, 1995)
91. A. Sayer, Method in Social Science: A Realist Approach, 2nd edn. (Routledge, London, 1992)
92. W.R. Shadish, T.D. Cook, D.T. Campbell, Experimental and Quasi-Experimental Designs for Generalized Causal Inference (Houghton Mifflin Company, Boston, 2002)
93. M. Shaw, D. Garlan, Software Architecture: Perspective on an Emerging Discipline (Prentice Hall, Upper Saddle River, 1996)
94. H. A. Simon, The Sciences of the Artificial (MIT Press, Cambridge, 1969)
95. D. I.K. Sjpberg, T. Dybá, M. Jörgensen, The future of empirical methods in software engineering research, in Future of Software Engineering (IEEE Computer Society, Los Alamitos, 2007), pp. 358-378
96. L. Wasserman, All of Statistics. A Concise Course in Statistical Inference (Springer, Heidelberg, 2004)
97. R.S. Westfall, The Construction of Modern Science: Mechanisms and Mechanics (Cambridge University Press, Cambridge, 2005); First printing Wiley, 1971
98. R. Wieringa, Real-world semantics of conceptual models, in The Evolution of Conceptual Modeling, ed. by R. Kaschek, L. Delcambre. Lecture Notes in Computer Science, vol. 6520 (Springer, Heidelberg, 2011), pp. 1-20
99. R.J. Wieringa, Design Methods for Reactive Systems: Yourdon, Statemate and the UML (Morgan Kaufmann, Burlington, 2003)
100. R.J. Wieringa, W. de Jonge, Object identifiers, keys, and surrogates—object identifiers revisited. Theory Pract. Object Syst. 1(2), 101-114 (1995)
101. W. Bechtel, A. Abrahamsen, Explanation: a mechanistic alternative. Studies in the Hist. Philos. Biol. Biomed. Sci. 36, 421-441 (2005)
102. W. Bechtel, R.C. Richardson, Discovering Complexity: Decomposition and Localization as Strategies in Scientific Research (MIT Press, Cambridge, 2010); Reissue of the 1993 edition with a new introduction
103. R.A. Berk, Causal inference for sociological data, in Handbook of Sociology, ed. by N.J. Smelser. (Sage, Thousand Oaks, 1988), pp. 155-172
104. M. Bunge, How does it work? The search for explanatory mechanisms. Philos. Soc. Sci. 34(2), 182-210 (2004)
105. N. Cartwright, How the Laws of Physics Lie (Oxford University Press, Oxford, 1983)
106. N. Cartwright, Nature’s Capacities and Their Measurement (Clarendon Press, Oxford 1989)
107. A. Cournand, M. Meyer. The scientist’s code. Minerva 14(1), 79-96 (1976)
108. C.F. Craver, Structure of scientific theories, in The Blackwell Guide to the Philosophy of Science, ed. by P. Machamer, M. Silberstein (Blackwell, Oxford, 2002), pp. 55-79
109. R. Cummins, ‘How does it work?’ versus ‘What are the laws?’: two conceptions of psychological explanation, in Explanation and Cognition, ed. by F.C. Keil, R.A. Wilson (MIT Press, Cambridge, 2000), pp. 117-144
110. J. Elster, Nuts and Bolts for the Social Sciences (Cambridge University Press, Cambridge, 1989)
111. J. Elster, A plea for mechanisms, in Social Mechanisms. An Analytical Approach to Social Theory, ed. by P. Hedstrom, R. Swedberg (Cambridge University Press, Cambridge, 1998), pp. 45-73
112. W. Engelsman, D.A.C. Quartel, H. Jonkers, M.J. van Sinderen, Extending enterprise architecture modelling with business goals and requirements. Enterp. Inf. Syst. 5(1), 9-36(2011)
113. W. Engelsman, R.J. Wieringa, Goal-oriented requirements engineering and enterprise architecture: Two case studies and some lessons learned, in Requirements Engineering: Foundation for Software Quality (REFSQ 2012), Essen, Germany. Lecture Notes in Computer Science, vol. 7195 (Springer, Heidelberg, 2012), pp. 306-320
114. S. Glennan, Rethinking mechanistic explanation. Philos. Sci. 69, S342-S353 (2002)
115. S.S. Glennan, Mechanisms and the nature of causation. Erkenntnis 44, 49-71 (1996)
116. P. Godfrey-Smith, Theory and Reality. An Introduction to the Philosophy of Science (The University of Chicago Press, Chicago, 2003)
117. J. H. Goldthorpe, Causation, statistics, and sociology. Eur. Sociol. Rev. 17(1), 1-20 (2001)
118. S. Gregor, The nature of theory in information systems. MIS Q. 30(3), 611-642 (2006)
119. S. Gregor, D. Jones, The anatomy of a design theory. J. AIS 8(5), 312-335 (2007)
120. P. Hedstrom, R. Swedberg (eds.), Social Mechanisms. An Analytical Approach to Social Theory (Cambridge University Press, Cambridge, 1998)
121. P. Hedstrom, P. Ylikoski, Causal mechanisms in the social sciences. Ann. Rev. Sociol. 36, 49-67 (2010)
122. C. Hitchcock, Probabilistic causation, in The Stanford Encyclopedia of Philosophy, ed. By E.N. Zalta. Spring 2010 edition (2010)
123. P.W. Holland, Statistics and causal inference. J. Am. Stat. Assoc. 81(396), 945-960 (1986)
124. T. Huynh, J. Miller, An empirical investigation into open source web applications’ implementation vulnerabilities. Empir. Softw. Eng. 15(5), 556-576 (2010)
125. ISO, Systems and Software Engineering —Architecture Description. ISO/IEC/IEEE (2007)
126. A. Kaplan, The Conduct of Inquiry. Methodology for Behavioral Science (Transaction Publishers, Pscataway, 1998); First edition 1964 by Chandler Publishers
127. K. S. Kendler, Explanatory models for psychiatric illness. Am. J. Psychiatry 6, 695-702 (2008)
128. T. Kuhn, The Structure of Scientific Revolutions, 2nd edn. (University of Chicago Press, Chicago, 1970)
129. I. Lakatos, Falsification and the methodology of scientific research programmes, in Criticism and the Growth of Knowledge, ed. by I. Lakatos, A. Musgrave (Cambridge University Press, Cambridge, 1970), pp. 91-196
130. I. Lakatos, Proofs and Refutations (Cambridge University Press, Cambridge, 1976); Edited by J. Worall and E. Zahar
131. L. Prechelt, B. Unger-Lamprecht, M. Philippsen, W.F. Tichy, Two controlled experiments assessing the usefulness of design pattern documentation in program maintenance. IEEE Trans. Softw. Eng. 28(6), 595-606 (2002)
132. P. Machamer, A brief historical introduction to the philosophy of science, in The Blackwell Guide to the Philosophy of Science, ed. by P. Machamer, M. Silberstein (Blackwell, Oxford, 2002), pp. 1-17
133. P. Machamer, L. Darden, C.F. Craver, Thinking about mechanisms. Philos. Sci. 67, 1-25 (2000)
134. P. McKay Illaii, J. Williamson, What is a mechanism? Thinking about mechanisms across the sciences. Eur. J. Philos. Sci. 2, 119-135 (2012)
135. P. Menzies, Counterfactual theories of causation, in The Stanford Encyclopedia of Philosophy, ed. by E.N. Zalta. Fall 2009 edition (2009)
136. R. K. Merton, The normative structure of science, in Social Theory and Social Structure (The Free Press, New York, 1968), pp. 267-278. Enlarged Edition
137. S. Morgan, X. Winship, Counterfactuals and Causal Inference. Methods and Principles for Social Research (Cambridge University Press, Cambridge, 2007)
138. M. Parascandola, D.L. Weed, Causation in epidemiology. J. Epidemiol. Commun. Health 55, 905-912(2001)
139. J. Pearl, Causal inference in statistics: an overview. Stat. Surv. 3, 96-146 (2009)
140. J. Pearl, Causality. Models, Reasoning and Inference, 2nd edn. (Cambridge University Press, Cambridge, 2009)
141. K. R. Popper, The Logic of Scientific Discovery (Hutchinson, London, 1959)
142. W.S. Robinson, The logical structure of analytic induction. Am. Sociol. Rev. 16(6), 812-818 (1951)
143. D.B. Rubin, Bayesian inference for causal effects: The role of randomization. Ann. Stat. 6(1), 34-58 (1978)
144. F. Russo, J. Williamson, Interpreting causality in the health sciences. Int. Stud. Philos. Sci. 21(2), 157-170 (2007)
145. F. Russo, J. Williamson, Generic versus single-case causality: The case of autopsy. Eur. J. Philos. Sci. 1(1), 47-69 (2011)
146. D.I.K. Sjpberg, T. Dyba, B.C.D. Anda, J.E. Hannay, Building theories in software engineering, in Guide to advanced empirical software engineering, ed. by F. Shull, J. Singer, D.I.K. Sjpberg (Springer, Heidelberg, 2008), pp. 312-336
147. P. Thagard, Explaining disease: correlations, causes, and mechanisms, in Explanation and Cognition, ed. by F.C. Keil, R.A. Wilson (MIT Press, Cambridge, 2000), pp. 255-276
148. R.J. Wieringa, M. Daneva, N. Condori-Fernandez, The structure of design theories, and an analysis of their use in software engineering experiments, in International Symposium on Empirical Software Engineering and Measurement (ESEM) (IEEE Computer Society, Los Alamitos, 2011), pp. 295-304
149. J. Woodward, Making Things Happen. A Theory of Causal Explanation (Oxford University Press, Oxford, 2003)
150. J. Woodward, Causation and manipulability, in The Stanford Encyclopedia of Philosophy, ed. by E.N. Zalta. Summer 2013 edition. http://plato.stanford.edu/cgi-bin/encyclopedia/archinfo.cgi?entry=causation-mani
151. N. Condori-Fernandez, R. Wieringa, M. Daneva, B. Mutschler, O. Pastor, Experimental evaluation of a unified checklist for designing and reporting empirical research in software engineering. Technical Report TR-CTIT-12-12, Centre for Telematics and Information Technology University of Twente, 2012
152. A. Jedlitschka, D. Pfahl, Reporting guidelines for controlled experiments in software engineering, in Proceedings of the 4th International Symposium on Empirical Software Engineering (ISESE 2005) (IEEE Computer Society, Los Alamitos, 2005), pp. 94-104
153. B. A. Kitchenham, S.L. Pfleeger, D.C. Hoaglin, K.E. Emam, J. Rosenberg, Preliminary guidelines for empirical research in software engineering. IEEE Trans. Softw. Eng. 28(8), 721-733 (2002)
154. P Runeson, M. Höst, Guidelines for conducting and reporting case study research in software engineering. Empir. Softw. Eng. 14, 131-164 (2009)
155. P. Runeson, M. Höst, A. Rainer, B. Regnell, Case Study Research in Software Engineering: Guidelines and Examples (Wiley, Hoboken, 2012)
156. W.R. Shadish, T.D. Cook, D.T. Campbell, Experimental and Quasi-Experimental Designs for Generalized Causal Inference (Houghton Mifflin Company, Boston, 2002)
157. R.J. Wieringa, Towards a unified checklist for empirical research in software engineering: first proposal, in 16th International Conference on Evaluation and Assessment in Software Engineering (EASE 2012), ed. by T. Baldaresse, M. Genero, E. Mendes, M. Piattini (IET, 2012), pp. 161-165
158. R.J. Wieringa, A unified checklist for observational and experimental research in software engineering (version 1). Technical Report TR-CTIT-12-07, Centre for Telematics and Information Technology University of Twente, 2012
159. R. Wieringa, N. Condori-Fernandez, M. Daneva, B. Mutschler, O. Pastor, Lessons learned from evaluating a checklist for reporting experimental and observational research, in International Symposium on Empirical Software Engineering and Measurement (ESEM). IEEE Computer Society, Los Alamitos, (September 2012), pp. 157-160
160. C. Wohlin, P. Runeson, M. Höst, M. C. Ohlsson, B. Regnell, A. Weslén, Experimentation in Software Engineering, 2nd edn. (Springer, Heidelberg, 2012)
161. M. Bailey, D. Dittrich, E. Kenneally, D. Maughan, The Menlo report. IEEE Secur. Privacy 10(2), 71-75 (2012)
162. V.R. Basili, G. Caldiera, H.D. Rombach, Goal question metric paradigm, in Encyclopedia of Software Engineering, vol. 1, ed. by J.J. Marciniak (Wiley, Hoboken, 1994), pp. 528-532
163. A. Field, Discovering Statistics Using SPSS, 3rd edn. (Sage, Thousand Oaks, 2009)
164. D. Freedman, R. Pisani, R. Purves, Statistics, 4th edn. (Norton & Company, New York, 2007)
165. N. Juristo, A. Moreno, Basics of Software Engineering Experimentation (Kluwer, Dordrecht, 2001)
166. A. Kaplan, The Conduct of Inquiry. Methodology for Behavioral Science (Transaction Publishers, Piscataway, 1998). First edition 1964 by Chandler Publishers
167. L. Kish, Statistical Design for Research (Wiley, Hoboken, 2004)
168. D. Moher, S. Hopewell, K. Schulz, V. Montori, P.C. Gptzsche, PJ. Devereaux, D. Elbourne, M. Egger, D.G. Altman, for the CONSORT Group, CONSORT 2010 Explanation and Elaboration: updated guidelines for reporting parallel group randomised trials. Br. Med. J. 340:c869 (2010)
169. L. Prechelt, B. Unger-Lamprecht, M. Philippsen, W.F. Tichy, Two controlled experiments assessing the usefulness of design pattern documentation in program maintenance. IEEE Trans. Softw. Eng. 28(6), 595-606 (2002)
170. K.F. Schulz, D.G. Altman, D. Moher, CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials. Ann. Intern. Med. 152(11), 1-7 (2010)
171. J.A. Singer, N.G. Vinson, Ethical issues in empirical studies of software engineering. IEEE Trans. Softw. Eng. 28(12), 1171-1180 (2002)
172. S.S. Stevens, On the theory of scales of measurement. Science 103(2684), 677-680 (1946)
173. B. G. Tabachnick, L.S. Fidell, Using Multivariate Statistics, 5th edn. (Pearson, Upper Saddle River, 2007)
174. PF. Velleman, L. Wilkinson, Nominal, ordinal, interval and ratio typologies are misleading. Am. Stat. 47(1), 65-72 (1993)
175. K. Charmaz, Constructing Grounded Theory: A Practical Guide Through Qualitative Research (Sage, Thousand Oaks, 2007)
176. M. Denscombe, The Good Research Guide For Small-Scale Social Research Projects, 4th edn. (Open University Press, Maidenhead, 2010)
177. D. Karlstrom, P. Runeson, Integrating agile software development into stage-gated managed product development. Empir. Softw. Eng. 11, 203-225 (2006)
178. J.A. Maxwell, Understanding and validity in qualitative research. Harv. Educ. Rev. 62(3), 279-300 (1992)
179. M.B. Miles, A.M. Huberman, J. Saldana, Qualitative Data Analysis. A Methods Sourcebook, 3rd edn. (Sage, Thousand Oaks, 2013)
180. M.Q. Patton, Qualitative Research and Evaluation Methods, 3rd edn. (Sage, Thousand Oaks, 2001)
181. Z. Racheva, M. Daneva, A. Herrmann, K. Sikkel, R.J. Wieringa, Do we know enough about requirements prioritization in agile projects: insights from a case study, in 18th International IEEE Requirements Engineering Conference, Sydney. (IEEE Computer Society, Los Alamitos, October 2010), pp. 147-156
182. C. Robson, Real World Research, 2nd edn. (Blackwell, Oxford, 2002)
183. S.B. Thomson, Qualitative research: validity. J. Adm. Gov. 6(1), 77-82 (2011)
184. L. Warne, D. Hart, The impact of organizational politics on information systems project failure-a case study, in Proceedings of the Twenty-Ninth Hawaii International Conference on System Sciences, vol. 4, pp. 191-201 (Jan 1996)
185. L. Wasserman, All of Statistics. A Concise Course in Statistical Inference (Springer, Heidelberg, 2004)
186. R.P. Abelson, A retrospective on the significance test ban of 1999 (If there were no significance tests, they would be invented), in What If There Were No Significance Tests?, ed. by L.L. Harlow, S.A. Mulaik, J.H. Steiger (Lawrence Erlbaum, Mahwah, 1997), pp. 117-141
187. D. Bakan, The test of significance in psychological research. Psychol. Bull. 66(6), 423-437 (1966)
188. J.O. Berger, Statistical Decision Theory and Bayesian Analysis, 2nd edn. (Springer, Heidelberg, 1980)
189. J.O. Berger, Could Fisher, Jeffreys and Neyman have agreed on testing? Stat. Sci. 18, 1-32 (2003)
190. R.A. Berk, Toward a methodology for mere mortals. Sociol. Methodol. 21, 315-324 (1991)
191. R.A. Berk, D.A. Freedman, Statistical assumptions as empirical commitments, in Law, Punishment, and Social Control: Essays in Honor of Sheldon Messinger, 2nd edn., ed. By T.G. Blomberg, S. Cohen (Aldine de Gruyter, Berlin, 2005), pp. 235-254. Reprinted in [21, pp. 23-43]
192. J. Berkson, Tests of significance considered as evidence. Int. J. Epidemiol. 32, 687-691 (2003). [Originally published in J. Am. Stat. Assoc. 37, 325-335 (1942)]
193. A. Birnbaum, The Neyman-Pearson theory as decision theory, and as inference theory; with a criticism of the lindley-savage argument for Bayesian theory. Synthese, 36(1), 19-49 (1977)
194. R.C. Bolles, The difference between statistical hypotheses and scientific hypotheses. Psychol. Rep. 11, 639-645 (1962)
195. J.P. Campbell, Some remarks from the outgoing editor. J. Appl. Psychol. 67, 691-700 (1982)
196. R.P. Carver, The case against statistical significance testing. Harv. Education. Rev. 48(8), 378-399 (1978)
197. J. Cohen, The earth is round (p 0.05). Am. Psychol. 49(12), 997-1003 (1994)
198. P.R. Cohen, Empirical Methods for Artificial Intelligence (Bradford Books, Cambridge, 1995)
199. D.R. Cooper, P.S. Schindler, Business Research Methods, 8th edn. (Irwin/McGraw-Hill, Homewood/Singapore, 2003)
200. D.R. Cox, Some problems connected with statistical inference. Ann. Math. Stat. 29(2), 357-372(1958)
201. R. Falk, C.W. Greenbaum, Significance tests die hard. The amazing persistence of a probabilistic misconception. Theory Psychol. 5(1), 75-98 (1995)
202. A. Field, Discovering Statistics Using SPSS, 3rd edn. (Sage, Thousand Oaks, 2009)
203. R.A. Fisher, Statistical methods and scientific induction. J. R. Stat. Soc. B 17, 69-77 (1955)
204. R.A. Fisher, Statistical Methods and Scientific Inference (Oliver & Boyd, Edinburgh, 1956)
205. D. Freedman, R. Pisani, R. Purves, Statistics, 4th edn. (Norton & Company, New York, 2007)
206. D.A. Freedman, Statistical Models and Causal Inference: A Dialogue With the Social Sciences, ed. by D. Collier, J.S. Sekhon, P.B. Stark (Cambridge University Press, Cambridge, 2010)
207. G. Gigerenzer, Mindless statistics. J. Socio Econ. 33, 587-606 (2004)
208. G. Gigerenzer, D.J. Murray, Cognition as Intuitive Statistics. (Lawrence Erlbaum, Mahwah, 1987). Chap. 1, The Inference Revolution
209. G. Gigerenzer, Z. Swijtink, T. Porter, L. Daston, J. Beatty, L. Krüger, The Empire of Chance: How Probability Changed Science and Everyday Life (Cambridge University Press, Cambridge, 1989)
210. G. Gigerenzer, S. Krauss, O. Vitouch, The Null ritual: what you always wanted to know about significance testing but were afraid to ask, in The Sage Handbook of Quantiative Methodology for the Social Sciences, ed. by D. Kaplan (Sage, Thousand Oaks, 2004.), pp. 391-408
211. I. Hacking, An Introduction to Probability and Inductive Logic (Cambridge University Press, Cambridge, 2001)
212. A. Hajek, Interpretations of probability, in The Stanford Encyclopedia of Philosophy, Winter 2012 edn., ed. by E.N. Zalta, (2012). http://plato.stanford.edu/cgi-bin/encyclopedia/archinfo.cgi?entry=probability-interpret
213. P.G. Halpin, H.J. Stam, Inductive inference or inductive behavior: Fisher and Neyman-Pearson approaches to statistical testing in psychological research (1940-1960). Am. J. Psychol. 119(4), 625-653 (2006)
214. L.L. Harlow, S.A. Mulaik, J.H. Steiger (eds). What If There Were No Significance Tests? (Lawrence Erlbaum, Mahwah, 1997)
215. C. Hildebrand, G. Häubl, A. Herrmann, J.R. Landwher, When social media can be bad for you: community feedback stifles consumer creativity and reduces satisfaction with self-designed products. Inf. Syst. Res. 24(1), 14-29 (2013)
216. R. Hubbard, M.J. Bahyarri, Confusion over measures of evidence (p’s) versus errors (a’s) in classical statistical testing. Am. Statistician 57(3), 171-182 (2003)
217. T. Huynh, J. Miller, An empirical investigation into open source web applications’ implementation vulnerabilities. Empir. Softw. Eng. 15(5), 556-576 (2010)
218. H. F. Inman, Karl Pearson and R. A. Fisher on statistical tests: a 1935 exchange from Nature. Am. Statistician 48(1), 2-11 (1994)
219. N. Juristo, A. Moreno, Basics ofSoftware Engineering Experimentation (Kluwer, Dordrecht, 2001)
220. C. Lambdin, Significance tests as sorcery: science is empirical—significance tests are not. Theory Psychol. 22(1), 67-90 (2012)
221. J. Lenhard, Models and statistical inference: the controversy between Fisher and Neyman-Pearson. Br. J. Philos. Sci. 57, 69-91 (2006)
222. D. T. Lykken, Statistical significance in psychological research. Psychol. Bull. 70(3), 151-159 (1968)
223. PE. Meehl, Theory-testing in psychology and physics: a methodological paradox. Philos. Sci. 34(2), 103-115 (1967)
224. P.E. Meehl, Theoretical risks and tabular asterisks: Sir Karl, Sir Ronald, and the slow progress of soft psychology. J. Consult. Clin. Psychol. 46, 806-834 (1978)
225. PE. Meehl, Why summaries of research on psychological theories are often uninterpretable. Psychol. Rep. 66, 195-244 (1990)
226. D.E. Morrison, R.E. henkel (eds.) The Significance Test Controversy: A Reader (Aldline Transaction, Piscataway, 2006)
227. J. Neyman, “inductive behavior” as a basic concept in the philosophy of science. Rev. Int. Stat. Institute. 25(1/3), 7-22 (1957)
228. R. Nola, H. Sankey, Theories of Scientific Method (Acumen, Stocksfield, 2007)
229. K. R. Popper, The Logic of Scientific Discovery (Hutchinson, London, 1959)
230. J.M. Robins, L. Wasserman, On the impossibility of inferring causation from association without background knowledge, in Computation, Causation, and Discovery. P. Glymour, G. Cooper (eds.) (The MIT Press, Cambridge, 1999), pp. 305-321
231. W.W. Rozeboom, The fallacy of the null-hypothesis significance test. Psychol. Bull. 57(5), 416-428 (1960)
232. W.R. Shadish, T.D. Cook, D.T. Campbell, Experimental and Quasi-Experimental Designs for Generalized Causal Inference (Houghton Mifflin Company, Boston, 2002)
233. Z. Swijtink, The objectification of observation: measurement and statistical methods in the nineteenth century, in The Probabilistic Revolution. Volume I: Ideas in History. L. Krüger, L.J. Daston, and M. Heidelberger (eds.) (MIT Press, Cambridge, 1987), pp. 261-285
234. J.W. Tukey, Conclusions vs decisions. Technometrics 2(4), 423-433 (1960)
235. R.W. Tyler, What is statistical significance? Educ. Res. Bull. 10(5), 115-118, 142 (1931)
236. L. Wasserman, All of Statistics. A Concise Course in Statistical Inference (Springer, Heidelberg, 2004)
237. R.R. Wilcox, Introduction to Robust Estimation and Hypothesis Testing, 2nd edn. (Academic Press, Waltham, 2005)
238. C. Wohlin, P. Runeson, M. Höst, M. C. Ohlsson, B. Regnell, A. Weslén, Experimentation in Software Engineering, 2nd edn. (Springer, Heidelberg, 2012)
239. T.H. Wonnacott, R.J. Wonnacott, Introductory Statistics for Business and Economics, 4th edn. (Wiley, Hoboken, 1990)
240. W. Bechtel, R.C. Richardson, Discovering Complexity: Decomposition and Localization as Strategies in Scientific Research (MIT Press, Cambridge, 2010). Reissue of the 1993 edition with a new introduction
241. R.A. Berk, Causal inference for sociological data, in Handbook of Sociology, ed. by N.J. Smelser (Sage, Thousand Oaks, 1988), pp. 155-172
242. T.D. Cook, D.T. Campbell, Quasi-Experimentation: Design and Analysis Issues for Field Settings (Rand-McNally, Skokie, 1979)
243. D. Damian, J. Chisan, An empirical study of the complex relationships between requirements engineering processes and other processes that lead to payoffs in productivity, quality and risk management. IEEE Trans. Softw. Eng. 32(7), 433-453 (2006)
244. I. Douven, Abduction, in The Stanford Encyclopedia of Philosophy, ed. by A.N. Zalta. Spring 2011 Edition (2011)
245. D.A. Freedman, Statistical models and shoe leather. Sociol. Methodol. 21, 291-313 (1991). Reprinted in [7, p. 45-62]
246. D.A. Freedman, Statistical Models and Causal Inference: A Dialogue With the Social Sciences, ed. by D. Collier, J.S. Sekhon, P.B. Stark (Cambridge University Press, Cambridge, 2010)
247. N. Groen, Overheid krijgt geen grip of IT-projecten. Automatiseringsgids, 11th April 2013, pp. 22-23
248. C. Hildebrand, G. Häubl, A. Herrmann, J.R. Landwher, When social media can be bad for you: Community feedback stifles consumer creativity and reduces satisfaction with self-designed products. Inf. Syst. Res. 24(1), 14-29 (2013)
249. P.W. Holland, Statistics and causal inference. J. Am. Stat. Assoc. 81(396), 945-960 (1986)
250. D. S. Janzen, H. Saiedian, Does test-driven development really improve software design quality? IEEE Softw. 25(2), 77-84 (2008)
251. N. Juristo, A. Moreno, Basics of Software Engineering Experimentation (Kluwer, Dordrecht, 2001)
252. B. Kitchenham, D.I.K. Sjpberg, R. Dybâ, O.P. Brereton, D. Budgen, M. Höst, P. Runeson, Trends in the quality of human-centric software engineering experiments—a quasi-experiment. IEEE Trans. Softw. Eng. 39(7), 1002-1017 (2013)
253. B. A. Kitchenham, S.L. Pfleeger, D.C. Hoaglin, K.E. Emam, J. Rosenberg. Preliminary guidelines for empirical research in software engineering. IEEE Trans. Softw. Eng. 28(8), 721-733 (2002)
254. T. Kuhn, The Structure of Scientific Revolutions, 2nd enlarged edn. (University of Chicago Press, Chicago, 1970)
255. M. Mooney Marini, B. Singer, Causality in the social sciences. Sociol. Methodol. 18, 347-409 (1988)
256. A. Wter Mors, The World According to MARP. PhD thesis, Delft University of Technology, March 2010. http://www.st.ewi.tudelft.nl/~adriaan/pubs/terMorsPhDthesis.pdf
257. M.D. Myers. A disaster for everyone to see: An interpretive analysis of a failed IS project. Account. Manag. Inf. Technol. 4(4), 185-201 (1994)
258. R. Pawson, N. Tilley, Realistic Evaluation (Sage, Thousand oaks, 1997)
259. Z. Racheva, M. Daneva, A. Herrmann, A conceptual model of client-driven agile requirements prioritization: Results of a case study, in IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM), ed. by G. Succi, M. Morisio, N. Nagappan, Bolzano. (ACM, New York, 2010), pp. 39:1-39:4
260. D.B. Rubin, Bayesian inference for causal effects: The role of randomization. Ann. Stat. 6(1), 34-58 (1978)
261. D.B. Rubin, Which ifs have causal answers. J. Am. Stat. Assoc. 81(396), 961-962 (1986)
262. R. Sabherwal, The evolution of coordination in outsourced software development projects: A comparison of client and vendor perspectives. Inf. Organ. 13, 153-202 (2003)
263. G. Schurz, Patterns of abduction. Synthese 164, 201-234 (2008)
264. P. Sedgwick, Random sampling versus random allocation. Br. Med. J. 343, d7453 (2011). http://dx.doi.org/10.1136/bmj.d7453
265. W.R. Shadish, T.D. Cook, D.T. Campbell, Experimental and Quasi-Experimental Designs for Generalized Causal Inference (Houghton Mifflin, Boston, 2002)
266. J. Snow, On the mode of communication of cholera (1849)
267. J. Snow, On the model of propagation of cholera, part 1. Med. Times 24, 559-562 (29 November 1851)
268. J. Snow, On the model of propagation of cholera, part 2. Med. Times 24, 610-612 (13 December 1851)
269. S. G. West, J.C. Biesanz, S.C. Pitts, Causal inference and generalization in field settings: Experimental and quasi-experimental designs, in Handbook ofResearch Methods in Social and Personality Psychology, ed. by H.T. Reis, C.M. Judd (Cambridge University Press, Cambridge, 2000), pp. 40-84
270. C. Wohlin, P. Runeson, M. Höst, M. C. Ohlsson, B. Regnell, A. Weslén, Experimentation in Software Engineering: An Introduction (Kluwer, Dordrecht, 2002)
271. C. Wohlin, P. Runeson, M. Höst, M. C. Ohlsson, B. Regnell, A. Weslén, Experimentation in Software Engineering, 2nd edn. (Springer, Heidelberg, 2012)
272. P. Bartha, By Parallel Reasoning (Oxford University Press, Oxford, 2010)
273. L. J. Cronbach, Designing Evaluations of Educational and Social Programs (Jossey-Bass, San Francisco, 1982)
274. D. Damian, J. Chisan, An empirical study of the complex relationships between requirements engineering processes and other processes that lead to payoffs in productivity, quality and risk management. IEEE Trans. Softw. Eng. 32(7), 433-453 (2006)
275. G. Gigerenzer, External validity of laboratory experiments: the frequency-validity relationship. Am. J. Psychol. 97(2), 185-195 (1984)
276. C. Hildebrand, G. Häubl, A. Herrmann, J.R. Landwher, When social media can be bad for you: community feedback stifles consumer creativity and reduces satisfaction with self-designed products. Inf. Syst. Res. 24(1), 14-29 (2013)
277. R.W. Holt, D.A. Boehm-Davis, A.C. Shultz, Mental representations of programs for student and professional programmers, in Empirical Studies of Programmers: Second Workshop, G.M. Olson, S. Sheppard, E. Soloway (Ablex Publishing, Norwood, 1987), pp. 33-46 http://dl.acm.org/citation.cfm?id=54968.54971
278. M. Höst, B. Regnell, C. Wohlin, Using students as subjects - a comparative study of students and professionals in lead-time impact assessment. Empir. Softw. Eng. 5(3), 201-214 (2000)
279. I. Lakatos, Proofs and Refutations, ed. by J. Worall, E. Zahar (Cambridge University Press, Cambridge, 1976)
280. A. Mockus, R.T. Fielding, J. Herbsleb, A case study of open source software development: the Apache server, in Proceedings of the 22nd International Conference on Software Engineering (ICSE 2000) (ACM Press, New York, 2000), pp. 263-272
281. A. Mockus, R.T. Fielding, J.D. Herbsleb, Two case studies of open source software development: Apache and Mozilla. ACM Trans. Softw. Eng. Methodol. 11(3), 309-346 (2002)
282. L. Prechelt, B. Unger-Lamprecht, M. Philippsen, W.F. Tichy, Two controlled experiments assessing the usefulness of design pattern documentation in program maintenance. IEEE Trans. Softw. Eng. 28(6), 595-606 (2002)
283. W.S. Robinson, The logical structure of analytic induction. Am. Sociol. Rev. 16(6), 812-818 (1951)
284. P. Runeson, Using students as experiment subjects-an analysis on graduate and freshmen student data, in Proceedings of the Seventh International Confonference Empirical Assessment and Evaluation in Software Engineering (EASE’03), pp. 95-102 (2003)
285. R. Sabherwal, The evolution of coordination in outsourced software development projects: a comparison of client and vendor perspectives. Inf. Organ. 13, 153-202 (2003)
286. W.R. Shadish, T.D. Cook, D.T. Campbell, Experimental and Quasi-Experimental Designs for Generalized Causal Inference (Houghton Mifflin, Boston, 2002)
287. S. Sterrett, Similarity and dimensional analysis, in Handbook of the Philosophy of Science, Volume 9: Philosophy of Technology and the Engineering Sciences, ed. by A. Meijers (Elsevier, Amsterdam, 2009), pp. 799-824
288. M. Svahnberg, A. Aurum, C. Wohlin, Using students as subjects - an empirical evaluation, in Proceedings of the Second ACM-IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM’08) (ACM, New York, 2008), pp. 288-290
289. J. Tacq, Znaniecki’s analytical induction as a method of sociological research. Pol. Sociol. Rev. 158(2), 187-208 (2007)
290. W.G. Vincenti, What Engineers Know and How They Know It. Analytical Studies from Aeronautical History (Johns Hopkins, Baltimore, 1990)
291. P Willner, Methods for assessing the validity of animal models of human psychopathology, in Neuromethods Vol. 18: Animal Models in Psychiatry I, ed. by A. Boultin, G. Baker, M. Martin-Iverson (The Humana Press, New York, 1991), pp. 1-23
292. R.K. Yin, Case Study Research: Design and Methods (Sage, Thousand Oaks, 1984)
293. F. Znaniecki, The Method of Sociology (Octagon Books, New York, 1968). First printing 1934
294. T Gorschek, C. Wohlin, P. Garre, S. Larsson, A model for technology transfer in practice. IEEE Softw. 23(6), 88-95 (2006)
295. B. Mutschler, Modeling and simulating causal dependencies on process-aware information systems from a cost perspective. Ph.D. thesis, University of Twente, Enschede, January 2008. http://eprints.eemcs.utwente.nl/11864/
296. D. Damian, J. Chisan, An empirical study of the complex relationships between requirements engineering processes and other processes that lead to payoffs in productivity, quality and risk management. IEEE Trans. Softw. Eng. 32(7), 433-453 (2006)
297. M. Denscombe, The Good Research Guide For Small-Scale Social Research Projects, 4th edn. (Open University Press, Maidenhead, 2010)
298. K.M. Eisenhardt, Building theories from case study research. Acad. Manag. Rev. 14(4), 532-550(1989)
299. B. Flyvberg, Five misunderstandings about case-study research. Qual. Inq. 12(2), 219-245 (2006)
300. R.L. Glass, Pilot studies: What, why, and how. J. Syst. Softw. 36, 85-97 (1997)
301. M.M. Kennedy, Generalizing from single case studies. Eval. Q. 3(4), 661-678 (1979)
302. B. Kitchenham, L. Pickard, S.L. Pfleeger, Case studies for method and tool evaluation. IEEE Softw. 12(4), 52-62 (1995)
303. C. Robson, Real World Research, 2nd edn. (Blackwell, Oxford, 2002)
304. P. Runeson, M. Höst, A. Rainer, B. Regnell, Case Study Research in Software Engineering: Guidelines and Examples (Wiley, Hoboken, 2012)
305. J.M. Verner, J. Sampson, V. Tosic, N.A.A. Bakar, B.A. Kitchenham, Guidelines for industrially-based multiple case studies in software engineering, in Research Challenges in Information Science, 2009. RCIS 2009. Third International Conference on, 2009, pp. 313-324
306. L. Warne, D. Hart, The impact of organizational politics on information systems project failure-a case study, in Proceedings of the Twenty-Ninth Hawaii International Conference on System Sciences, vol. 4, 1996, pp. 191-201
307. R.J. Wieringa, Towards a unified checklist for empirical research in software engineering: first proposal, in 16th International Conference on Evaluation and Assessment in Software Engineering (EASE 2012), ed. by T. Baldaresse, M. Genero, E. Mendes, M. Piattini (IET, Ciudad Real, 2012), pp. 161-165
308. R.J. Wieringa, A unified checklist for observational and experimental research in software engineering (version 1). Technical Report TR-CTIT-12-07, Centre for Telematics and Information Technology University of Twente (2012)
309. R.K. Yin, Case Study research: Design and Methods (Sage, Thousand Oaks, 1984)
310. R.K. Yin, Case Study research: Design and Methods, 3rd edn. (Sage, Thousand Oaks, 2003)
311. A. Kumar, P.S. Ow, M.J. Prietula, Organizational simulation and information systems design: an operational level example. Manag. Sci. 39(2), 218-240 (1993)
312. R. Pawson, N. Tilley, Realistic Evaluation (Sage, Thousand Oaks, 1997)
313. H. Petroski, To Engineer is Human: The Role of Failure in Successful Design (Vintage books, New York, 1982)
314. H. Petroski, The Evolution of Useful Things (Vintage Books, New York, 1992)
315. J.D. Vrielink, Phased array processing: direction of arrival estimation on reconfigurable hardware. Master’s Thesis, Faculty of Electrical Engineering, Mathematics and Computer Science, University of Twente, January 2009. http://essay.utwente.nl/62065/
316. R.M. Davison, M.G. Martinsons, N. Kock, Principles of canonical action research. Inf. Syst. J. 14(1), 65-86 (2004)
317. W. Engelsman, R.J. Wieringa, Goal-oriented requirements engineering and enterprise architecture: two case studies and some lessons learned, in Requirements Engineering: Foundation for Software Quality (REFSQ 2012), Essen, Germany. Lecture notes in computer science, vol. 7195 (Springer, 2012), pp. 306-320.
318. W. Engelsman, D.A.C. Quartel, H. Jonkers, M.J. van Sinderen, Extending enterprise architecture modelling with business goals and requirements. Enterp. Inf. Syst. 5(1), 9-36 (2011)
319. K. Lewin, The research center for group dynamics at Massachusetts Institute of Technology. Sociometry 8(2), 126-136 (1945)
320. K. Lewin, Action research and minority problems. J. Soc. Issues 2, 34-46 (1946)
321. A. Morali, R.J. Wieringa, Risk-based confidentiality requirements specification for outsourced it systems, in Proceedings of the 18th IEEE International Requirements Engineering Conference (RE 2010), Sydney, Australia (IEEE Computer Society, Los Alamitos, California, 2010), pp. 199-208
322. H. Petroski, The Evolution of Useful Things (Vintage Books, New York, 1992)
323. R.J. Wieringa, Relevance and problem choice in design science, in Global Perspectives on Design Science Research (DESRIST), 5th International Conference, St. Gallen. Lecture Notes in Computer Science, vol. 6105 (Springer, Heidelberg, 2010), pp. 61-76
324. R.J. Wieringa, A. Morali, Technical action research as a validation method in information systems design science, in K. Peffers, M. Rothenberger, B. Kuechler (eds), Seventh International Conference on Design Science Research in Information Systems and Technology (DESRIST). Lecture Notes in Computer Science, vol. 7286 (Springer, Heidelberg, 2012), pp. 220-238
325. L. Briand, Y. Labiche, R. Madrazo-Rivera, An experimental evaluation of the impact of system sequence diagrams and system operation contracts on the quality of the domain model, in International Symposium on Empirical Software Engineering and Measurement (IEEE Computer Society, Los Alamitos, 2011), pp. 157-166
326. J. E. Hannay, A. Arisholm, H. Engvik, D.I.K. Sjpberg, Effects of personality on pair programming. IEEE Trans. Softw. Eng. 36(1) (2010)
327. P.W. Holland, Statistics and causal inference. J. Am. Stat. Assoc. 81(396), 945-960 (1986)
328. A. Jedlitschka, D. Pfahl, Reporting guidelines for controlled experiments in software engineering, in Proceedings of the 4th International Symposium on Empirical Software Engineering (ISESE 2005) (IEEE Computer Society, Los Alamitos, 2005), pp. 94-104
329. N. Juristo, A. Moreno, Basics of Software Engineering Experimentation (Kluwer, Dordrecht, 2001)
330. B. A. Kitchenham, S.L. Pfleeger, D.C. Hoaglin, K.E. Emam, J. Rosenberg, Preliminary guidelines for empirical research in software engineering. IEEE Trans. Softw. Eng. 28(8), 721-733 (2002)
331. C. Larman, Applying UML and Patterns (Prentice-Hall, Upper Saddle River, 1998)
332. D. Moher, S. Hopewell, K. Schulz, V. Montori, P.C. Gptzsche, PJ. Devereaux, D. Elbourne, M. Egger, D.G. Altman, for the CONSORT Group, CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials. Br. Med. J. 340:c869 (2010). http://www.bmj.com/content/340/bmj.c869
333. S.L. Pfleeger, Experimental design and analysis in software engineering. Ann. Softw. Eng. 1(1), 219-253 (1995)
334. C. Robson, Real World Research, 2nd edn. (Blackwell, Oxford, 2002)
335. N. Salleh, E. Mendes, J. Grundy, G.St.J. Burch, The effects of neuroticism on pair programming: an empirical study in the higher education context, in Proceedings of the 2010 ACM-IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM’10) (ACM, New York, 2010), pp. 22:1-22:10. http://dl.acm.org/citation.cfm?id=1852816&dl=ACM&coll=DL&CFID=541946863&CFTOKEN=30791837
336. K. F. Schulz, D.G. Altman, D. Moher, CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. Ann. Intern. Med. 152(11), 1-7 (2010)
337. W.R. Shadish, T.D. Cook, D.T. Campbell, Experimental and Quasi-Experimental Designs for Generalized Causal Inference (Houghton Mifflin, Boston, 2002)
338. L. Wasserman, All of Statistics. A Concise Course in Statistical Inference (Springer, Heidelberg, 2004)
339. R. Wieringa, N. Condori-Fernandez, M. Daneva, B. Mutschler, O. Pastor, Lessons learned from evaluating a checklist for reporting experimental and observational research, in International Symposium on Empirical Software Engineering and Measurement (ESEM) (IEEE Computer Society, Los Alamitos, September 2012), pp. 157-160
340. R.J. Wieringa, Towards a unified checklist for empirical research in software engineering: first proposal, in 16th International Conference on Evaluation and Assessment in Software Engineering (EASE 2012), T. Baldaresse, M. Genero, E. Mendes, M. Piattini (IET, 2012), pp. 161-165
341. R.J. Wieringa, A unified checklist for observational and experimental research in software engineering (version 1). Technical Report TR-CTIT-12-07, Centre for Telematics and Information Technology University of Twente, 2012
342. R.R. Wilcox, Introduction to Robust Estimation and Hypothesis Testing, 2nd edn. (Academic Press, Waltham, 2005)
343. C. Wohlin, P. Runeson, M. Höst, M.C. Ohlsson, B. Regnell, A. Weslen, Experimentation in Software Engineering, 2nd edn. (Springer, Heidelberg, 2012)