Responses to comprehension questions and verbal protocols as measures of computer program comprehension processes

Behaviour and Information Technology

Volumn 16, Issue 6, 1997, Pages 320-336

  Shaft, Teresa M ^a  

^a UNIVERSITY OF TULSA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER AIDED INSTRUCTION; COMPUTER SOFTWARE SELECTION AND EVALUATION; DATA ACQUISITION; DATA REDUCTION; NETWORK PROTOCOLS;

COMPUTER PROGRAM COMPREHENSION PROCESSES; PROCESS TRACING METHODS; VERBAL PROTOCOLS;

COGNITIVE SYSTEMS;

EID: 0031274650     PISSN: 0144929X     EISSN: 13623001     Source Type: Journal    
DOI: 10.1080/014492997119725     Document Type: Article

References (43)

1. Adelson, B. 1981, Problem solving and the development of abstract categories in programming languages, Memory and Cognition, 9, 422-433.
2. Bennett, K. H., Cornelius, B. J., Munro, M. and Robson, D. J. 1988, Software maintenance: A key area for research, University Computing, 10, 184-188.
3. Brooks, R. E. 1980, Studying programmer behaviour experimentally: The problems of proper methodology, Communications of the ACM, 23, 207-213.
4. Brooks, R. E. 1983, Towards a theory of the comprehension of computer programs, International Journal of Man-Machine Studies, 18, 543-554.
5. Chiesi, H. L., Spilich, G. J. and Voss, J. F. 1979, Acquisition of domain-related information in relation to high and low domain knowledge, Journal of Verbal Learning and Verbal Behavior, 18, 257-273.
6. Cohen, J. 1960, A coefficient of agreement for nominal scales, Educational and Psychological Measurement, 20, 37-46.
7. Curtis, B. 1986, By the way, did anyone study any real programmers? in E. S. Soloway and S. Iyengar (eds), Empirical Studies of Programmers: First Workshop, (Ablex Publishing, Norwood, NJ), 265-262.
8. Curtis, B., Sheppard, S. B., Kruesi-Bailey, E., Bailey, J. and Boehm-Davis, D. A. 1989, Experimental evaluation of software documentation formats, The Journal of Systems and Software, 8, 167-207.
9. Ericsson, K. A. and Simon, H. A. 1980, Verbal reports as data, Psychological Review, 87, 215-251.
10. Ericsson, K. A. and Simon, H. A. 1984, Protocol Analysis, Verbal Reports as Data, (MIT Press, Cambridge, MA).
11. Ford, J. K., Schmitt, N., Shechtman, S. L., Hults, B. M. and Doherty, M. L. 1989, Process tracing methods: contributions, problems and neglected research questions, Organizational Behavior and Human Decision Processes, 43, 75117.
12. Gellenbeck, E. M. and Cook, C. R. 1991, An investigation of procedure and variable names as beacons during program comprehension, in J. Koenemann-Belliveau, T. G. Moher and S. P. Robertson (eds), Empirical Studies of Programmers: Fourth Workshop, (Ablex Publishing, Norwood, NJ), 65-79.
13. Huynh, H. and Feldt, L. S. 1970, Conditions under which mean square ratios in repeated measurements designs have exact /-distributions, Journal of the American Statistical Association, 65, 1582-1589.
14. Jones, C. 1986, Programmer Productivity, (McGraw-Hill, New York).
15. Jones, C. 1994, Software metrics: Good, bad, and missing, IEEE Computer, September, 98-100.
16. Kemerer, C. F. 1995, Software complexity and software maintenance. A survey of empirical research, in J. D. Arthur and S. M. Sallie (eds), The Annals of Software Engineering I, (Baltzer Science Publishers, Amsterdam) 1-22.
17. Koele, P. 1982, Calculating power in analysis of variance. Psychological Bulletin, 92, 513-516.
18. Landis, J. R. and Koch, G. G. 1977, The measurement of observer agreement for categorical data, Biometrics, 33, 259-274.
19. Letovsky, S. 1986, Cognitive processes in program comprehension. in E. S. Soloway and S. Iyengar (eds), Empirical Studies of Programmers: First Workshop, (Ablex Publishing, Norwood, NJ), 58-79.
20. Lind, R. and Vairavan, K. 1989, An experimental study of software metrics and their relationship to software development effort, IEEE Transactions on Software Engineering, SE-15, 649-653.
21. Littman, D. C., Pinto, J., Letovsky, S and Soloway, E. 1986, Mental models and software maintenance, in E. S. Soloway and S. Iyengar (eds), Empirical Studies of Programmers: First Workshop, (Ablex Publishing, Norwood, NJ), 80-98.
22. Munson, J. C. and Khoshgoftaar, T. M. 1989, The dimensionality of program complexity. Proceedings of the International Conference on Software Engineering, 245-253.
23. Newell, A. and Simon, H. A. 1972, Human Problem Solving, (Prentice Hall, Englewood Cliffs, NJ).
24. Nisbett, R. E. and Wilson, T. D. 1977, Telling more than we can know: verbal reports on mental processes, Psychological Review, 84, 231-259.
25. Norman, D. A. 1983, Some observations on mental models, in D. Gentner and A. L. Stevens (eds), Mental Models, (Erlbaum, Hillsdale, NJ), 7-14.
26. Pennington, N. 1987a, Stimulus structures and mental representations in expert comprehension of computer programs, Cognitive Psychology, 19, 295-341.
27. Pennington, N. 1987b, Comprehension strategies in programming, in G. M. Olson, S. Sheppard and E. Soloway (eds), Empirical Studies of Programmers: Second Workshop, (Ablex Publishing, Norwood, NJ), 100-137.
28. th ed), (SAS Institute, Cary, NC).
29. Russo, J. E., Johnson, E. J. and Stephens, D. L. 1989, The validity of verbal protocols, Memory and Cognition, 17, 759-769.
30. Shaft, T. M. 1992, The role of application domain knowledge in computer program comprehension and enhancement, unpublished Doctoral Dissertaion, The Pennsylvania State University.
31. Shaft, T. M. and Vessey, I. 1995, The relevance of application domain knowledge: the case of computer program comprehension, Information Systems Research, 6, 286-297.
32. Sheil, B. A. 1981, The psychological study of programming, ACM Computing Surveys, 13, 101-120.
33. Shneiderman, B. and Mayer, R. 1979, Syntactic/semantic interaction in programmer behavior: a model and experimental results, International Journal of Computer and Information Sciences, 8, 10-24.
34. Smith, E. R. and Miller, F. D. 1978, Limits on perception of cognitive processes: A reply to Nisbett and Wilson, Psychological Review, 85, 355-362.
35. Spence, J. W. 1996, On developing a standard abilities-based measurement tool for task analysis: A preliminary experiment using computer programming tasks, Proceedings of the Second Annual AIS-Americas Conference, Phoenix, AZ.
36. Spilich, G. J., Vesonder, G. T., Chiesi, H. L. and Voss, J. F. 1979, Text processing of domain-related information for individuals with high and low domain knowledge, Journal of Verbal Learning and Verbal Behavior, 18, 275-290.
37. Tukey, J. W. 1953, The Problem of Multiple Comparisons, Unpublished Manuscript, Princeton University.
38. Vessey, I. 1988, Expert-novice knowledge organization: An empirical investigation using computer program recall, Behaviour & Information Technology, 7, 153-171.
39. White, P. 1980, Limitations on verbal reports of internal events: A refutation of Nisbett and Wilson and of Bem, Psychological Review, 87, 105-112.
40. Wiedenbeck, S. 1986, Processes in computer program comprehension. in E. S. Soloway and S. Iyengar (eds), Empirical Studies ofProgrammers: First Workshop, (Ablex Publishing, Norwood, NJ), 48-57.
41. Wiedenbeck, S. 1991, The initial stage of program comprehension, International Journal of Man-Machine Studies, 35, 517-540.
42. rd edition (McGraw-Hill, Inc., New York).
43. Zuse, H. 1991, Software Complexity, (Walter de Gruyter, New York).