A systematic review of theory use in software engineering experiments

IEEE Transactions on Software Engineering

Volumn 33, Issue 2, 2007, Pages 1000-9999

  Hannay, Jo E ^a   Sjøberg, Dag I K ^a   Dybå, Tore ^a  

^a SIMULA RESEARCH LABORATORY   (Norway)

Author keywords

Empirical software engineering; Experiments; Research methodology; Theory

Indexed keywords

ENGINEERING RESEARCH; SYSTEM THEORY;

EMPIRICAL SOFTWARE ENGINEERING; RESEARCH METHODOLOGY; SOFTWARE ENGINEERING RESEARCH;

SOFTWARE ENGINEERING;

EID: 33846859803     PISSN: 00985589     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSE.2007.12     Document Type: Review

References (182)

1. "ACM Computing Classification System," http://www.acm.org/class, 2004.
2. R. Agarwal, P. De, and A.P. Sinha, "Comprehending Object and Process Models: An Empirical Study," IEEE Trans. Software Eng., vol. 25, no. 4, pp. 541-556, July/Aug. 1999.
3. Principles of Forecasting: A Handbook for Researchers and Practitioners, J.S. Armstrong, ed. Kluwer Academic, 2001.
4. M.E. Atwood and H.R. Ramsey, "Cognitive Structures in the Comprehension and Memory of Computer Programs: An Investigation of Computer Program Debugging," Technical Report TR-78-A21, U.S. Army Research Inst. for the Behavioral and Social Sciences, 1978.
5. S.B. Bacharach, "Organizational Theories: Some Criteria for Evaluation," Academy of Management Rev., vol. 14, no. 4, pp. 496-515, 1989.
6. V.R. Basili, "Editorial," Empirical Software Eng., vol. 1, no. 2, pp. 105-108, Jan. 1996.
7. A.C. Benander, B.A. Benander, and J. Sang, "An Empirical Analysis of Debugging Performance-Differences between Iterative and Recursive Constructs," J. Systems and Software, vol. 54, no. 1, pp. 17-28, Sept. 2000.
8. A. Bianchi, F. Lanubile, and G. Visaggio, "A Controlled Experiment to Assess the Effectiveness of Inspection Meetings," Proc. Seventh Int'l Symp. Software Metrics, pp. 42-50, 2001.
9. B.W. Boehm and B. Clark, "Cost Models for Future Life Cycle Processes: COCOMO 2," Annals Software Eng., vol. 1, pp. 57-94, 1995.
10. D. Borsboom, G.J. Mellenbergh, and J. Van Heerden, "The Theoretical Status of Latent Variables," Psychological Rev., vol. 110, no. 2, pp. 203-219, 2003.
11. T. Boswell and C. Brown, "The Scope of General Theory," Sociological Methods & Research, vol. 28, no. 2, pp. 154-185, 1999.
12. L.F. Bourne, R.L. Dominowski, E.F. Loftus, and A.F. Healy, Cognitive Processes. Prentice Hall, 1986.
13. A. Brooks, F. Utbult, C. Mulligan, and R. Jeffery, "Early Lifecycle Work: Influence of Individual Characteristics, Methodological Constraints, and Interface Constraints," Empirical Software Eng., vol. 5, no. 3, pp. 269-285, Nov. 2000.
14. M. Bunge, Scientific Research I: The Search for a System. Springer Verlag, 1967.
15. M. Bunge, "Realism and Antirealism in Social Science," Theory and Decision, vol. 35, no. 3, pp. 207-235, 1993.
16. J.T. Cacioppo, G.R. Semin, and G.G. Berntson, "Realism, Instrumentalism, and Scientific Symbiosis," Am. Psychologist, vol. 59, no. 4, pp. 214-223, 2004.
17. B. Cohen, Developing Sociological Knowledge: Theory and Method. Prentice Hall, 1980.
18. L.J. Cronbach, Designing Evaluations of Social and Educational Programs. Josey-Bass, 1982.
19. L.J. Cronbach, S.R. Ambron, S.M. Dornbusch, R.D. Hess, R.C. Hornik, D.C. Phillips, D.F. Walker, and S.S. Weiner, Toward Reform of Program Evaluation. Josey-Bass, 1980.
20. J. Daly, A. Brooks, J. Miller, M. Roper, and M. Wood, "Evaluating Inheritance Depth on the Maintainability of Object-Oriented Software," Empirical Software Eng., vol. 1, no. 2, pp. 109-132, Jan. 1996.
21. D.E.H. Damian, A. Eberlein, M.L.G. Shaw, and B. Gaines, "Using Different Communication Media in Requirements Negotiation," IEEE Software, vol. 17, no. 3, pp. 28-36, May/June 2000.
22. D.D. Davis and C.A. Holt, Experimental Economics. Princeton Univ. Press, 1993.
23. M.S. Davis, "That's Interesting! Towards a Phenomenology of Sociology and a Sociology of Phenomenology," Philosophy of the Social Sciences, vol.1, pp. 309-344, 1971.
24. P.J. Dimaggio, "Comments on 'What Theory Is Not," Administrative Science Quarterly, vol. 40, pp. 391-397, 1995.
25. R. Dubin, Theory Building. Free Press, 1969.
26. R. Dubin, Theory Development. Free Press, 1978.
27. A. Endres and D. Rombach, A Handbook of Software and Systems Engineering, Fraunhofer IESE Series on Software Eng. Pearson Education Limited, 2003.
28. R.P. Feynman, QED - The Strange Theory of Light and Matter. Penguin Science, 1985.
29. R.P. Feynman, The Meaning of It All: Thoughts of a Citizen-Scientist. Perseus Books, 1998.
30. P. Fonagy and M. Target, Psychoanalytic Theories. Perspectives from Developmental Psychopathology. Whurr, 2003.
31. W.B. Frakes and T.P. Pole, "An Empirical Study of Representation Methods for Reusable Software Components," IEEE Trans. Software Eng., vol. 20, no. 8, pp. 617-630, Aug. 1994.
32. R. Franck, The Explanatory Power of Models. Kluwer Academic, 2002.
33. B. Freimut, O. Laitenberger, and S. Biffl, "Investigating the Impact of Reading Techniques on the Accuracy of Different Defect Content Estimation Techniques," Proc. Seventh Int'l Symp. Software Metrics, pp. 51-62, 2001.
34. K.J. Gergen, "Correspondence Versus Autonomy in the Language of Understanding Human Action," Metatheory in Social Science, D.W. Fiske and R.A. Schweder, eds. Univ. of Chicago Press, pp. 136-162, 1986.
35. G. Gigerenzer, "Mindless Statistics," J. Socio-Economics, vol. 33, pp. 587-606, 2004.
36. R.L. Glass, V. Ramesh, and I. Vessey, "An Analysis of Research in Computing Disciplines," Comm. ACM, vol. 47, no. 6, pp. 89-94, June 2004.
37. R.L. Glass, I. Vessey, and V. Ramesh, "Research in Software Engineering: An Analysis of the Literature," Information and Software Technology, vol. 44, no. 8, pp. 491-506, 2002.
38. S. Gregor, "The Nature of Theory in Information Systems," MIS Quarterly, vol. 30, no. 3, pp. 491-506, Sept. 2006.
39. T.R. Gruber, "A Translation Approach to Portable Ontology Specifications," Knowledge Acquisition, vol. 5, no. 2, pp. 199-220, 1993.
40. S. Hawking and R. Penrose, The Nature of Space and Time. Princeton Univ. Press, 1996.
41. S.M. Henry and K.T. Stevens, "Using Belbin's Leadership Role to Improve Team Effectiveness: An Empirical Investigation," J. Systems and Software vol. 44, no. 3, pp. 241-250, Jan. 1999.
42. R.L. Henschel, "Sociology and Prediction," Am. Sociologist, vol. 6, pp. 213-220, 1971.
43. J.D. Herbsleb and A. Mockus, "Formulation and Preliminary Test of an Empirical Theory of Coordination in Software Engineering," Proc. European Software Eng. Conf./ACM SIGSOFT Symp. Foundations of Software Eng., pp. 112-121, 2003.
44. U. Hoffrage, R. Hertwig, and G. Gigerenzer, "Hindsight Bias: A By-Product of Knowledge Updating?" J. Experimental Psychology: Learning, Memory, and Cognition, vol. 26, pp. 566-581, 2000.
45. G.C. Homans, "Bringing Men Back In," The Philosophy of Social Explanation, A. Ryan, ed., Oxford Univ. Press, pp. 50-64, 1973.
46. F. Houdek, "External Experiments - A Workable Paradigm for Collaboration between Industry and Academia," Lecture Notes on Empirical Software Eng., vol. 12, N. Juristo and A.M. Moreno, eds., chapter 4, World Scientific, vol. 12, 2003.
47. G.S. Howard, T. Bodnovich, T. Janicki, J. Liegle, S. Klein, P. Albert, and D. Cannon, "The Efficacy of Matching Information Systems Development Methodologies with Application Characteristics - An Empirical Study," J. Systems and Software, vol. 45, no. 3, pp. 177-195, Mar. 1999.
48. P. Humphreys, "Mathematical Modeling in Social Sciences," Philosophy of the Social Sciences, S.P. Turner and P.A. Roth, eds. Blackwell, 2003.
49. "IEEE Keyword Taxonomy," http://www.computer.org/mc/keywords/ software.htm, 2004.
50. R. Jeffery and L.G. Votta, "Guest Editor's Special Section Introduction," IEEE Trans. Software Eng., vol. 25, no. 4, pp. 435-437, July/Aug. 1999.
51. Handbook of Cognitive Psychophysiology: Central and Autonomic Nervous System Approaches, J.R. Jennings and M.G.H. Coles, eds. Wiley, 1991.
52. E.E. Jones, "Major Developments in Social Psychology during the Five Past Decades," The Handbook of Social Psychology, third ed., G. Lindzey and E. Aronsen, eds., chapter 2, pp. 47-107, Random House, 1985.
53. M. Jørgensen and G.J. Carelius, "An Empirical Study of Software Project Bidding," IEEE Trans. Software Eng., vol. 30, no. 12, pp. 953-969, Dec. 2004.
54. N. Juristo and A.M. Moreno, Basics of Software Engineering Experimentation. Kluwer Academic, 2003.
55. A. Kaplan, The Conduct of Inquiry, Chandler, 1964.
56. B.A. Kitchenham, "Procedures for Performing Systematic Reviews," Technical Report TR/SE-0401, Keele Univ., and Technical Report 0400011T.1, NICTA, 2004.
57. B.A. Kitchenham, S.L. Pfleeger, L.M. Pickard, P.W. Jones, D.C. Hoaglin, K. El Emam, and J. Rosenberg, "Preliminary Guidelines for Empirical Research In Software Engineering," IEEE Trans. Software Eng., vol. 28, no. 8, pp. 721-734, Aug. 2002.
58. J. Koskinen, "Experimental Evaluation of Hypertext Access Structures," Software Maintenance and Evolution, vol. 14, no. 2, pp. 83-108, 2002.
59. O. Laitenberger, C. Atkinson, M. Schlich, and K. El Emam, "An Experimental Comparison of Reading Techniques for Defect Detection in UML Design Documents," J. Systems and Software, vol. 53, no. 2, pp. 183-204, Aug. 2000.
60. O. Laitenberger and H.M. Dreyer, "Evaluating the Usefulness and the Ease of Use of A Web-Based Inspection Data Collection Tool," Proc. Fifth Int'l Symp. Software Metrics, pp. 122-132, 1998.
61. O. Laitenberger and H.D. Rombach, "(Quasi-)Experimental Studies in Industrial Settings," Lecture Notes on Empirical Software Engineering, vol. 12, N. Juristo and A.M. Moreno, eds., chapter 5, pp. 167-227, World Scientific, 2003.
62. K. Lewin, "The Research Center for Group Dynamics at Massachusetts Institute of Technology," Sociometry, vol. 8, pp. 126-135, 1945.
63. C.E. Lindblom, "Alternatives to Validity: Some Thoughts Suggested by Campbell's Guidelines," Knowledge Creation, Diffusion, Utilization, vol. 8, pp. 509-520, 1987.
64. J.W. Lucas, "Theory-Testing, Generalization, and the Problem of External Validity," Sociological Theory, vol. 21, no. 3, pp. 236-253, 2003.
65. S.A. Lynham, "The General Method of Theory-Building Research in Applied Disciplines," Advances in Developing Human Resources, vol. 4, no. 3, pp. 221-241, Aug. 2002.
66. B. Markovsky, "The Structure of Theories," Group Processes, M. Foschi and E.J. Lawler, eds., pp. 3-24, Nelson-Hall, 1994.
67. R.A. Maxion and R.T. Olszewski, "Eliminating Exception Handling Errors With Dependability Cases: A Comparative, Empirical Study," IEEE Trans. Software Eng., vol. 26, no. 9, pp. 888-906, Sept. 2000.
68. E. McMullin, "A Case for Scientific Realism," Scientific Realism, J. Leplin, ed., Univ. of California Press, 1984.
69. J. Miller, M. Wood, and M. Roper, "Further Experiences with Scenarios and Checklists," Empirical Software Eng., vol. 3, no. 1, pp. 37-64, Mar. 1998.
70. B. Mohr, Explaining Organizational Behavior. Josey Bass, 1982.
71. E. Nagel, The Structure of Science: Problems in the Logic of Scientific Explanation. Harcourt, Brace and World, 1961.
72. E. Nagel, The Structure of Science. Hackett, 1979.
73. D.A. Norman, The Design of Everyday Things. Basic Books, 1988.
74. D. Papineau, "Philosophy of Science," The Blackwell Companion to Philosophy, N. Bunnin and E.P. Tsui-James, eds. Blackwell, 1996.
75. S.L. Pfleeger, "Albert Einstein and Empirical Software Engineering," Computer, vol. 32, no. 10, pp. 32-38, Oct. 1999.
76. A.A. Porter, H.P. Siy, C.A. Toman, and L.G. Votta, "An Experiment to Assess the Cost-Benefits of Code Inspections in Large Scale Software Development," IEEE Trans. Software Eng., vol. 23, no. 6, pp. 329-346, June 1997.
77. L. Prechelt, B. Unger, W.F. Tichy, P. Brossler, and L.G. Votta, "A Controlled Experiment in Maintenance: Comparing Design Patterns to Simpler Solutions," IEEE Trans. Software Eng., vol. 27, no. 12, pp. 1134-1144, Dec. 2001.
78. L. Prechelt, B. Unger-Lamprecht, M. Philippsen, and W.F. Tichy, "Two Controlled Experiments Assessing the Usefulness of Design Pattern Documentation in Program Maintenance," IEEE Trans. Software Eng., vol. 28, no. 6, pp. 595-606, June 2002.
79. R. Rorty, Consequences of Pragmatism. Univ. of Minnesota Press, 1982.
80. A. Rosenberg, Philosophy of Science, A Contemporary Introduction. Routledge, 2001.
81. P.J. Runkel and M. Runkel, A Guide to Usage for Writers and Students in the Social Sciences. Rowman and Allanheld, 1984.
82. M. Ruse, "Theory," The Oxford Companion to Philosophy, T. Honderich, ed., Oxford Univ. Press, pp. 870-871, 1995.
83. D. Sandborg, "Mathematical Explanation and the Theory of Why-Questions," British J. Philosophy of Science, vol. 49, no. 4, pp. 603-624, Dec. 1998.
84. D.P. Schwab, "Construct Validity in Organizational Behavior," Research in Organizational Behavior, vol. 2, B.M. Staw and L.L. Cummings, eds., pp. 3-43, AI Press, 1980.
85. W.R. Shadish,T.D. Cook,and D.T. Campbell, Experimentaland Quasi-Experimental Designs for Generalized Causal Inference. Houghton Mifflin, 2002.
86. H.A. Simon, The Sciences of the Artificial, third ed., MIT Press, 1996.
87. D.I.K. Sjøoberg, J.E. Hannay, O. Hansen, V.B. Kampenes, A. Karahasanovibc, N.K. Liborg, and A.C. Rekdal, "A Survey of Controlled Experiments in Software Engineering," IEEE Trans. Software Eng., vol. 31, no. 9, pp. 733-753, Sept. 2005.
88. R.I. Sutton and B.M. Staw, "What Theory Is Not," Administrative Science Quarterly, vol. 40, pp. 371-384, 1995.
89. W.F. Tichy, "Should Computer Scientist Experiment More? 16 Excuses to Avoid Experimentation," Computer, vol. 31, no. 5, pp. 32-40, May 1998.
90. W.M.K. Trochim, The Research Methods Knowledge Base. Atomic Dog, 2001.
91. A.H. Van de Ven, "Nothing Is Quite So Practical as a Good Theory," Academy of Management Rev., vol. 14, no. 4, pp. 486-489, 1989.
92. K.G. van den Berg and P.M. van den Broek, "Programmers' Performance on Structured versus Nonstructured Function Definitions," Information and Software Technology, vol. 38, no. 7, pp. 477-492, July 1996.
93. B. Van Fraassen, The Scientific Image. Oxford Univ. Press, 1980.
94. I. Vessey, "Toward a Theory of Computer Program Bugs: An Empirical Test," Int'l J. Man-Machine Studies, vol. 30, no. 1, pp. 23-46, 1989.
95. D.G. Wagner, "The Growth of Theories," Group Processes, M. Foschi and E.J. Lawler, eds., pp. 25-42, Nelson-Hall, 1994.
96. W.S. Waller and M.F. Zimbelman, "A Cognitive Footprint in Archival Data: Generalizing the Dilution Effect from Laboratory to Field Settings," Organizational Behavior and Decision Processes, vol. 91, pp. 254-268, 2003.
97. R. Weber, "Editor's Comments," MIS Quarterly, vol. 27, no. 3, pp. iii-xii, Sept. 2003.
98. M. Webster Jr., "Experimental Methods," Group Processes, M. Foschi and E.J. Lawler, eds. Nelson-Hall, pp. 43-69, 1994.
99. K.E. Weick, "Theory Construction as Disciplined Imagination," Academy of Management Rev., vol. 14, no. 4, pp. 516-531, 1989.
100. K.E. Weick, "What Theory Is Not, Theorizing Is," Administrative Science Quarterly, vol. 40, pp. 385-390, 1995.
101. D.A. Whetten, "What Constitutes a Theoretical Contribution," Academy Of Management Rev., vol. 14, no. 4, pp. 490-495, 1989.
102. C. Wohlin, P. Runeson, M. Höst, M.C. Ohlsson, B. Regnell, and A. Wesslen, Experimentation in Software Engineering: An Introduction. Kluwer Academic, 1999.
103. R.K. Yin, Case Study Research: Design and Methods, third ed., Applied Social Research Methods Series, vol. 5. Sage, 2003.
104. Z. Zhang, V. Basili, and B. Shneiderman, "Perspective-Based Usability Inspection: An Empirical Validation of Efficacy," Empirical Software Eng., vol. 4, no. 1, pp. 43-69, Mar. 1999.
105. T.K. Abdel-Hamid, K. Sengupta, and D. Ronan, "Software Project Control: An Experimental Investigation of Judgment with Fallible Information," IEEE Trans. Software Eng., vol. 19, no. 6, pp. 603-612, June 1993.
106. R. Agarwal, "Cognitive Fit in Requirements Modeling: A Study of Object and Process Methodologies," J. Management Information Systems, vol. 13, no. 2, pp. 137-162, 1996.
107. R.N. Anthony and J. Dearden, Management Control Systems. Richard D. Irwin, 1980.
108. E. Arisholm, D.I.K. Sjøoberg, and M. Jorgensen, "Assessing the Changeability of Two Object-Oriented Design Alternatives - A Controlled Experiment," Empirical Software Eng., vol. 6, no. 3, pp. 231-237, Sept. 2001.
109. K.J. Arrow, Essays in the Theory of Risk-Bearing. North-Holland, 1970.
110. R. Atkinson, D. Herrmann, and K. Wescourt, "Search Processes in Recognition Memory," Theories in Cognitive Psychology: The Loyola Symposium, R.L. Solso, ed. Lawrence Earlbaum Assoc., 1974.
111. R. Atkinson and R. Shiffrin, "Human Memory: A Proposed System and Its Control Process," Advances of Psychological Theory of Learning and Motivation Research and Theory, vol. 2, K.W. Spence and J.D. Spence, eds., Academic, 1968.
112. A.O. Awani, Data Processing Project Management, Petrocelli, 1986.
113. H. Barki, S. Rivard, and J. Talbot, "Toward an Assessment of Software Development Risk," J. Management Information Systems, vol. 10, no. 2, pp. 203-225, 1993.
114. R.M. Belbin, Management Teams. Wiley, 1981.
115. R.M. Belbin, Team Roles at Work. Butterworth-Heinemann, 1993.
116. B.J. Biddle, Role Theory: Expectation, Identities, and Behaviors. Academic Press, 1979.
117. R. Brooks, "Towards a Theory of the Comprehension of Computer Programs," Int'l J. Man-Machine Studies, vol. 18, no. 6, pp. 543-554, June 1983.
118. R. Brooks, "Using a Behavioral Theory of Program Comprehension in Software Engineering," Proc. Third Int'l Conf. Software Eng., pp. 196-201, 1998.
119. J.M. Burkhardt, F. Détienne, and S. Wiedenbeck, "Object-Oriented Program Comprehension: Effect of Expertise, Task and Phase," Empirical Software Eng., vol. 7, no. 2, pp. 115-156, June 2002.
120. W.G. Chase and H.A. Simon, "The Mind's Eye in Chess," Visual Information Processing, W.G. Chase, ed., Academic, 1973.
121. N. Chomsky, "Aspects of Theory of Syntax," technical report, MIT Press, 1965.
122. A. Collins and E. Loftus, "A Spreading Activation Theory of Semantic Processing," Psychology Rev., vol. 82, pp. 407-428, 1975.
123. R.L. Daft and R.K. Lengel, "Organizational Information Requirements, Media Richness and Structural Design," Management Science, vol. 32, no. 5, pp. 554-571, 1986.
124. F.D. Davis, R.P. Bagozzi, and P.R. Warshaw, "User Acceptance of Computer Technology: A Comparison of Two Theoretical Models," Management Science, vol. 35, no. 8, pp. 982-1003, Aug. 1989.
125. D. Day, M. Ahuja, and L. Scott, "Constraints in Design Engineering: A Report of Research in Progress," Proc. Eighth Australian Conf. Information Systems, pp. 509-516, 1997.
126. K. Duncker, "On Problem Solving," Psychology Monograph, vol. 58, chapter 5, Am. Psychological Assoc., 1945.
127. J. Dvorak, "Conceptual Entropy and Its Effect on Class Hierarchies," IEEE Computer, vol. 27, no. 6, pp. 59-63, June 1994.
128. W. Edwards, "Conservatism in Human Information Processing," Formal Representation of Human Judgment, B. Kleinmuntz, ed., Wiley, 1968.
129. E. Feigenbaum, "Information Processing and Memory," Models of Memory, D.A. Norman, ed. Academic, 1970.
130. J. Greeno, "The Structure of Memory and the Process of Solving Problems," Contemporary Issues in Cognitive Psychology: The Loyola Symposium, R.L. Solso, ed., Wiley, 1973.
131. D.L. Harnett and L.L. Cummings, Bargaining Behavior: An International Study. Dame, 1980.
132. W.E. Hick, "On the Rate of Gain of Information," Quarterly J. Experimental Psychology, vol. 4, pp. 11-26, 1952.
133. R. Hogarth, "Beyond Discrete Biases: Functional and Dysfunctional Aspects of Judgmental Heuristics," Psychological Bull., vol. 90, no. 2, pp. 197-217, 1981.
134. R. Hyman, "Stimulus Information as a Determinant of Reaction Time," J. Experimental Psychology, vol. 45, pp. 188-196, 1953.
135. M. Keil, L. Wallace, D. Turk, G. Dixon-Randall, and U. Nulden, "An Investigation of Risk Perception and Risk Propensity on the Decision to Continue a Software Development Project," J. Systems and Software, vol. 53, no. 2, pp. 145-157, Aug. 2000.
136. J. Klayman and Y.W. Ha, "Confirmation, Disconfirmation, and Information In Hypothesis Testing," Psychological Rev., vol. 94, no. 2, pp. 221-228, 1987.
137. E.S. Knowles, "From Individuals to Group Members: A Dialectic for the Social Sciences," Personality, Roles and Social Behavior, W. Ickes and E.S. Knowles, eds., Springer, 1982.
138. N. Kogan and M.A. Wallach, Risk Taking: A Study in Cognition and Personality. Holt, Rinehart, and Winston, 1964.
139. R. Krovi and A. Chandra, "User Cognitive Representations: The Case for an Object-Oriented Model," J. Systems and Software, vol. 43, no. 3, pp. 165-176, Nov. 1998.
140. O. Laitenberger, K. El Emam, and T.G. Harbich, "An Internally Replicated Quasi-Experimental Comparison of Checklist and Perspective Based Reading of Code Documents," IEEE Trans. Software Eng., vol. 27, no. 5, pp. 387-421, May 2001.
141. L.P.W. Land, C. Sauer, and R. Jeffery, "The Use of Procedural Roles in Code Inspections: An Experimental Study," Empirical Software Eng., vol. 5, no. 1, pp. 11-34, Mar. 2000.
142. S. Letovsky, "Cognitive Processes in Program Comprehension," Proc. First Workshop Empirical Studies of Programmers, pp. 58-79, 1986.
143. S. Letovsky and E. Soloway, "Delocalized Plans and Program Comprehension," IEEE Software, vol. 3, no. 3, pp. 41-49, May 1986.
144. K.B. Lloyd and D.J. Jankowski, "A Cognitive Information Processing and Information Theory Approach to Diagram Clarity: A Synthesis and Experimental Investigation," J. Systems and Software, vol. 45, no. 3, pp. 203-214, Mar. 1999.
145. I. Lorge, D. Fox, J. Davitz, and M. Brenner, "A Survey of Studies Contrasting the Quality of Group Performance and Individual Performance, 1920-1957," Psychological Bull., vol. 55, no. 6, pp. 337-371, 1958.
146. J.E. McGrath and A.B. Hollingshead, Groups Interacting with Technology: Ideas, Evidence, Issues and an Agenda. Sage, 1994.
147. B.A. Mellers and S. Chang, "Representations of Risk Judgments," Organizational Behavior and Human Decision Processes, vol. 57, no. 2, pp. 167-184, 1994.
148. G.A. Miller, "The Magical Number Seven, Plus or Minus Two: Some Limits on Our Capacity for Processing Information," Psychological Rev., vol. 63, pp. 81-97, 1956.
149. A. Newell and H.A. Simon, Human Problem Solving. Prentice Hall, 1972.
150. A. Paivio, Imagery and Verbal Processes. Holt, Rinehart, and Winston, 1971.
151. R. Palmer and I. Rock, "Rethinking Perceptual Organization: The Role of Uniform Connectedness," Psychometric Bull. and Rev., vol. 1, no. 1, pp. 29-55, 1994.
152. N. Pennington, "Comprehension Strategies in Programming," Proc. Second Workshop Empirical Studies of Programmers, pp. 100-113, 1987.
153. N. Pennington, "Stimulus Structures and Mental Representations in Expert Comprehension of Computer Programs," Cognitive Psychology, vol. 19, pp. 295-341, 1987.
154. A.A. Porter, H. Siy, A. Mockus, and L. Votta, "Understanding the Sources of Variation in Software Inspections," ACM Trans. Software Eng. Methodology, vol. 7, no. 1, pp. 41-79, 1998.
155. S. Ramanujan, R.W. Scamell, and J.R. Shah, "An Experimental Investigation of the Impact of Individual, Program, and Organizational Characteristics on Software Maintenance Effort," J. Systems and Software, vol. 54, no. 2, pp. 137-157, Oct. 2000.
156. P. Reisner, "Human Factors Studies of Database Query Languages: A Survey and Assessment," ACM Computing Surveys, vol. 13, pp. 13-31, 1981.
157. E. Rosch, "Principles of Categorization," Cognition and Categorization, Lawrence Erlbaum, 1978.
158. T.R. Sarbin, "Role Theory," Handbook of Social Psychology, G. Lindzey, ed., Addison-Wesley, 1954.
159. C. Sauer, R. Jeffery, L.P.W.Land,andP. Yetton, "Understandingand Improving the Effectiveness of Software Development Technical Reviews: A Behaviourally Motivated Programme of Research," IEEE Trans. Software Eng., vol. 26, no. 1, pp. 1-14, Jan. 2000.
160. C.E. Shannon, "A Mathematical Theory of Communication," Bell System Technical J., vol. 27, pp. 379-423, 1948.
161. B. Shneiderman, "Measuring Computer Program Quality and Comprehension," Int'l J. Man-Machine Studies, vol. 9, no. 1, pp. 465-478, 1977.
162. L. Short, E. Williams, and B. Christie, The Social Psychology of Telecommunications. John Wiley & Sons, 1976.
163. S.B. Sitkin and A.L. Pablo, "Reconceptualizing the Determinants of Risk Behavior," Academy of Management Rev., vol. 17, no. 1, pp. 9-38, 1992.
164. E.E. Smith, "Concepts and Thought," The Psychology of Human Thought, Cambridge Univ. Press, 1988.
165. E.E. Smith and D.L. Medin, Categories and Concepts. Harvard Univ. Press, 1981.
166. E. Soloway, J. Pinto, S. Letovsky, D. Littman, and R. Lampert, "Designing Documentation to Compensate for Delocalized Plans," Comm. ACM, vol. 31, no. 11, pp. 1259-1267, Nov. 1988.
167. I.D. Steiner, Group Process and Productivity, Academic, 1972.
168. E. Tulving, "Episodic and Semantic Memory," Organization and Memory, E. Tulving and W. Donaldson, eds., Academic, 1972.
169. A. Tversky and D. Kahneman, "Judgement under Uncertainty: Heuristics and Biases," Science, vol. 185, no. 27, pp. 1124-1131, Sept. 1974.
170. T.A. van Dijk and W. Kintsch, Strategies of Discourse Comprehension. Academic, 1983.
171. I. Vessey, "Cognitive Fit: A Theory-Based Analysis of the Graphs versus Tables Literature," Decision Sciences, vol. 22, no. 2, pp. 219-240, 1991.
172. I. Vessey and D. Galletta, "Cognitive Fit: An Empirical Study of Information Acquisition," Information Systems Research, vol. 2, pp. 63-84, Mar. 1991.
173. R. Vinter, M. Loomes, and D. Kornbrot, "Applying Software Metrics to Formal Specifications: A Cognitive Approach," Proc. Fifth Int'l Symp. Software Metrics, pp. 216-223, 1998.
174. A. von Mayrhauser and S. Lang, "A Coding Scheme to Support Systematic Analysis of Software Comprehension," IEEE Trans. Software Eng., vol. 25, no. 4, pp. 526-540, July/Aug. 1999.
175. A. von Mayrhauser and A.M. Vans, "Industrial Experience with an Integrated Code Comprehension Model," Software Eng. J., vol. 10, no. 5, pp. 171-182, Sep. 1995.
176. A. von Mayrhauser, A.M. Vans, and A.E. Howe, "Program Understanding Behaviour during Enhancement of Large-Scale Software," Software Maintenance: Research and Practice, vol. 9, pp. 299-327, 1997.
177. M. Wertheimer, "Untersuchungen Zurlehre von der Gestalt: II," Psychologische Forschung, vol. 4, pp. 301-350, 1923.
178. M. Wertheimer, Productive Thinking. Harper & Row, 1959.
179. W.A. Wickelgren, How to Solve Problems. Freeman, 1974.
180. W.A. Wickelgren, Learning and Memory, Personality, Roles and Social Behavior. Prentice Hall, 1977.
181. S. Wiedenbeck, "Novice/Expert Differences in Programming Skills," Int'l J. Man-Machine Studies, vol. 23, no. 4, pp. 383-390, 1985.
182. M.Y.M. Yen and R.W. Scamell, "A Human Factors Experimental Comparison of SQL and QBE," IEEE Trans. Software Eng., vol. 19, no. 4, pp. 390-409, Apr. 1993.