Applying Code Inspection to Spreadsheet Testing

Journal of Management Information Systems

Volumn 16, Issue 2, 1999, Pages 159-176

  Panko, Raymond R ^a,b  

^a UNIVERSITY OF HAWAII   (United States)

^b STANFORD UNIVERSITY   (United States)

Author keywords

Code inspection; Error detection; Spreadsheet errors; Spreadsheet testing

Indexed keywords

EID: 0033277397     PISSN: 07421222     EISSN: None     Source Type: Journal    
DOI: 10.1080/07421222.1999.11518250     Document Type: Article

References (48)

1. Allwood, C.M. Error detection processes in statistical problem solving. Cognitive Science, 8, 4 (1984), 413-437.
2. Baars, B.J. A new ideomotor theory of voluntary control. In B.J. Baars (ed.), Experimental Slips and Human Error. New York: Plenum, 1992, pp. 93-120.
3. Basili, V.R., and Perricone, B.T. Software errors and complexity: an empirical investigation. In M. Sheppard (ed.), Software Engineering Metrics, Vol. 1: Measures and Validation. Berkshire, UK: McGraw-Hill, 1993, pp. 168-183.
4. Basili, V.R., and Selby, R.W., Jr. Four applications of a software data collection and analysis methodology. In J.K. Skwirzynski (ed.), Software System Design Methodology. Berlin: Springer-Verlag, 1986, pp. 3-33.
5. Bolger, F., and Wright, G. Reliability and validity in expert judgment. In G. Wright and F. Bolger (eds.), Expertise and Decision Support. New York: Plenum, 1992, pp. 47-76.
6. Brown, P.S., and Gould, J.D. An experimental study of people creating spreadsheets. ACM Transactions on Office Information Systems, 5, 3 (1987), 258-272.
7. Camerer, C.F., and Johnson, E.C. The process-performance paradox in expert judgment: how can experts know so much and predict so badly? In K.A. Ericsson and J. Smith (eds.), Toward a General Theory of Expertise. Cambridge: Cambridge University Press, 1991, pp. 195-217.
8. Cragg, P.G., and King, M. Spreadsheet modelling abuse: an opportunity for OR? Journal of the Operational Research Society, 44, 8 (1993), 743-752.
9. Davies, N., and Ikin, C. Auditing spreadsheets. Australian Account (1987), 54-56.
10. Dunning, D.; Griffin, D.W.; Milojkovic, J.D.; and Ross, L. The overconfidence effect in social prediction. Journal of Personality and Social Psychology, 4 (1990), 568-581.
11. Ebenau, R.G., and Strauss, S.H. Software Inspection Process. New York: McGraw-Hill, 1994.
12. Fagan, M.E. Design and code inspections to reduce errors in program development. IBM Systems Journal, 15, 3 (1976), 182-211.
13. Flower, L.A., and Hayes, J.R. The dynamics of composing: making plans and juggling constraints. In L.W. Gregg and E.R. Steinberg (eds.), Cognitive Processes in Writing. Hillsdale, NJ: Lawrence Erlbaum, 1980, pp. 31-50.
14. Floyd, B.D.; Walls, J.; and Marr, K. Managing spreadsheet model development. Journal of Systems Management, 46, 1 (1995), 38-43, 68.
15. Galletta, D.F.; Abraham, D.; El Louadi, M.; Lekse, W.; Pollailis, Y.A.; and Sampler, J.L. An empirical study of spreadsheet error performance. Journal of Accounting, Management, and Information Technology, 3, 2 (1993), 79-95.
16. Galletta, D.F.; Hartzel, K.S.; Johnson, S.; and Joseph, J.L. An experimental study of spreadsheet presentation and error detection. Proceedings of the Twenty-Ninth Hawaii International Conference on System Sciences, vol. 2, January 1996, pp. 336-345.
17. Galletta, D.F.;, Hartzel, K.S.; Johnson, S.; and Joseph, J.L. Spreadsheet presentation and error detection: an experimental study. Journal of Management Information Systems, 13, 2 (1997), 45-63.
18. Hall, M.J.J. A risk and control oriented study of the practices of spreadsheet application developers. Proceedings of the Twenty-Ninth Hawaii International Conference on System Sciences, vol. 2, January 1996, pp. 364-373.
19. Hayes, J.R., and Flower, L.S. Identifying the organization of writing processes. In L. Gregg and E. Steinbert (eds.), Cognitive Processes in Writing. Hillsdale, NJ: Lawrence Erlbaum, 1980, pp. 3-30.
20. Healey, A.F. Proofreading errors on the word the: new evidence on reading units. Journal of Experimental Psychology: Human Perception and Performance, 6, 1 (1980), 45-57.
21. Hicks, L. NYNEX. Personal communication with the author by electronic mail, June 21, 1995.
22. Johnson, E.J. Expertise and decision under uncertainty: performance and process. In M.T.H. Chi, R. Glaser, and M.J. Farr (eds.), The Nature of Expertise. Hillsdale, NJ: Lawrence Erlbaum, 1988, pp. 209-228.
23. Johnson, P., and Tjahjono, D. Exploring the effectiveness of formal technical review factors with CSRS. Proceedings of the 1997 International Conference on Software Engineering, Boston, May 1997.
24. Lichtenstein, S., and Fischoff, B. Training for calibration. Organizational Behavior and Human Performance, 26 (1980), 149-171.
25. Lichtenstein, S.; Fischoff, B.; and Philips, L.D. Calibration of probabilities: the state of the art to 1980. In D. Kahneman, P. Slovic, and A. Tversky (eds.), Judgment Under Uncertainty: Heuristics and Biases. Cambridge: Cambridge University Press, 1982, pp. 306-334.
26. MacKay, D.G. The problems of flexibility, fluency, and speed-accuracy trade-offs in skilled behavior. Psychological Review, 89 (1982), 483-506.
27. Metcalfe, J., and Shimamura, A.P. Metacognition: Knowing About Knowing. Cambridge, MA: MIT Press, 1994.
28. Myers, G.J. A controlled experiment in program testing and code walkthroughs/inspections. Communications of the ACM, 21, 9 (1978), 760-768.
29. Norman, D.A. Converging industries: the multiple impacts of converging industries on politeness, the individual, society and nations. Paper presented at the Thirtieth Hawaii International Conference on System Sciences, Maui, Hawaii, January 1997.
30. Panko, R.R. A human error data website (http://panko.cba.hawaii.edu/humanerr/). Honolulu, HI: University of Hawaii, 1997.
31. Panko, R.R. Spreadsheet research (SSR) website (http://panko.cba.hawaii.edu/ssr/). Honolulu, HI: University of Hawaii, 1997.
32. Panko, R.R., and Halverson, R.P., Jr. Spreadsheets on trial: a framework for research on spreadsheet risks. Proceedings of the Twenty-Ninth Hawaii International Conference on System Sciences, vol. 2, January 1996, pp. 326-335.
33. Panko, R.R., and Halverson, R.P., Jr. Are two heads better than one? (at reducing errors in spreadsheet modeling?). Office Systems Research Journal, 15, 1 (1997), 21-32.
34. Panko, R.R., and Sprague, R.H.J. Hitting the wall: errors in developing and code-inspecting a "simple" spreadsheet model. Decision Support Systems, 22, 4 (1998), 337-353.
35. Pious, S. A comparison of strategies for reducing interval overconfidence in group judgments. Journal of Applied Psychology, 80, 4 (1995), 443-454.
36. Porter, A.; Votta, L.G., Jr.; and Basili, V.R. Comparing detection methods for software requirements inspections: a replicated experiment. IEEE Transactions on Software Engineering, 21, 6 (1995), 563-575.
37. Porter, A.A., and Johnson, P.M. Assessing software review meetings: results of a comparative analysis of two experimental studies. IEEE Transactions on Software Engineering, 23, 3 (1997), 129-145.
38. Porter, A.A.; Sly, H.P.; Toman, C.A.; and Votta, L.G. An experiment to assess the cost-benefits of code inspections in large scale software development. IEEE Transactions on Software Engineering, 23, 6 (1997), 329-346.
39. Porter, A.A., and Votta, L.G. An experiment to assess different defect detection methods for software requirements inspections. Proceedings of the Sixteenth International Conference on Software Engineering, Sorento, Italy, May 16-21, 1994, pp. 103-112.
40. Pulford, B.D., and Coleman, A.M. Overconfidence, base rates and outcome positivity/negativity of predicted events. British Journal of Psychology, 87 (1996), 431-445.
41. Rasmussen, J. Mental procedures in real-life tasks: a case of electronics troubleshooting. Ergonomics, 17, 3 (1974), 293-307.
42. Rasmussen, J. The role of perception in organizing behavior. Ergonomics, 33, 10-11 (1990), 1185-1199.
43. Reason, J.T. Human Error. Cambridge: Cambridge University Press, 1990.
44. Russell, G.W. Experience with inspection in ultralarge-scale developments. IEEE Software, 8, 1 (1991), 25-31.
45. Shanteau, J. The psychology of experts: an alternative view. In G. Wright and F. Bolger (eds.), Experts and Decision Support. New York: Plenum Press, 1992, pp. 11-23.
46. Votta, L.G. Does every inspection need a meeting? Proceedings of the ACM SIGSOFT '93 Symposium on Foundations of Software Engineering, December 1993.
47. Wagenaar, W. A., and Keren, G.B. Does the expert know? the reliability of predictions and confidence ratings of experts. In E. Hollnagel, G. Manici, and D.D. Woods (eds.), Intelligent Decision Support in Process Environments. Berlin: Springer-Verlag, 1986, pp. 87-103.
48. Weller, M. Lessons from three years of inspection data. IEEE Software, 10, 5 (1993), 38-45.