Interactive, visual fault localization support for end-user programmers

Journal of Visual Languages and Computing

Volumn 16, Issue 1-2 SPEC. ISS., 2005, Pages 3-40

  Ruthruff, Joseph R ^a,b   Prabhakararao, Shrinu ^a   Reichwein, James ^a   Cook, Curtis ^a   Creswick, Eugene ^a   Burnett, Margaret ^a  

^a OREGON STATE UNIVERSITY   (United States)

^b UNIVERSITY OF NEBRASKA LINCOLN   (United States)

Author keywords

Debugging; End user programming; End user software engineering; Form based visual programs; Slicing; Testing; Visual fault localization

Indexed keywords

EID: 13844307625     PISSN: 1045926X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jvlc.2004.07.001     Document Type: Article

References (66)

1. J. Reichwein, G. Rothermel, M. Burnett, Slicing spreadsheets: An integrated methodology for spreadsheet testing and debugging, in: Proceedings of the Second Conference on Domain Specific Languages, October 1999, pp. 25-38
2. B.W. Boehm C. Abts A.W. Brown S. Chulani Software Cost Estimation with COCOMO II 2000 Prentice-Hall, PTR Upper Sadle River, NJ
3. D. Cullen, Excel snafu costs firm $24 m, The Register, June 19, 2003, http://www.theregister.co.uk/content/67/31298.html, Last Accessed: July 19th, 2004
4. R. Panko, Finding spreadsheet errors: Most spreadsheet errors have design flaws that may lead to long-term miscalculation, Information Week, May 1995, p. 100
5. R. Panko, What we know about spreadsheet errors, Journal on End User Computing (1998) 15-21
6. ANSI/IEEE IEEE Standard Glossary of Software Engineering Terminology 1983 IEEE New York
7. C. Cook, M. Burnett, D. Boom, A bug's eye view of immediate visual feedback in direct-manipulation programming systems, in: Proceedings of Empirical Studies of Programmers: Seventh Workshop, Alexandria, VA, October 1997, pp. 20-41
8. M. Burnett G. Rothermel C. Cook End-user software engineering Communications of the ACM 47 9 2004 53-58
9. A. Ambler M. Burnett B. Zimmerman Operational versus definitional: A perspective on programming paradigms Computer 25 9 1992 28-43
10. E. Chi, J. Riedl, P. Barry, J. Konstan, Principles for information visualization spreadsheets, IEEE Computer Graphics and Applications, July/August 1998
11. B. Myers, Graphical techniques in a spreadsheet for specifying user interfaces, in: Proceedings of the ACM Conference on Human Factors in Computing Systems, May 1991, pp. 243-249
12. T. Smedley, P. Cox, S. Byme, Expanding the utility of spreadsheets through the integration of visual programming and user interface objects, in: ACM Workshop on Advanced Visual Interfaces, May 1996, pp. 148-155
13. A. Ambler, The Formulate visual programming language, Dr. Dobb's Journal (1999) 21-28
14. S. Peyton Jones, A. Blackwell, M. Burnett, A user-centered approach to functions in Excel, in: Proceedings of the ACM International Conference on Functional Programming, Uppsala, Sweden, August 25-29, 2003, pp. 165-176
15. G. Viehstaedt A. Ambler Visual representation and manipulation of matrices Journal of Visual Languages and Computing 3 3 1992 273-298
16. M. Burnett R. Hossli T. Pulliam B. VanVoorst X. Yang Toward visual programming languages for steering in scientific visualization: A taxonomy IEEE Computer Science and Engineering 1 4 1994
17. M. Burnett, S. Chekka, R. Pandey, FAR: An end-user language to support cottage e-services, in: Proceedings of the IEEE Symposium on Human-Centric Languages, Stresa, Italy, September 2001, pp. 195-202
18. M. Burnett J. Atwood R. Djang H. Gottfried J. Reichwein S. Yang Forms/3: a first-order visual language to explore the boundaries of the spreadsheet paradigm Journal of Functional Programming 11 2 2001 155-206
19. M. Burnett H. Gottfried Graphical definitions: Expanding spreadsheet languages through direct manipulation and gestures ACM Transactions on Computer-Human Interaction 5 1 1998 1-33
20. S. Reiss Visualization for software engineering-programming environments. In: J. Stasko J. Domingue M. Brown B. Price (Eds.). Software Visualization: Programming as a Multimedia Experience 1998 MIT Press Cambridge, MA 259-276
21. S. Reiss, Graphical program development with PECAN program development systems, in: Proceedings of the Symposium on Practical Software Development Environments, April 1984
22. T. Teitelbaum T. Reps The Cornell program synthesizer: A syntax directed programming environment Communications of the ACM 24 9 1981 563-573
23. D. Notkin R. Ellison G. Kaiser E. Kant A. Habermann V. Ambriola C. Montanegero Special issue on the Gandalf project Journal on Systems and Software 5 2 1985
24. H. Lieberman C. Fry ZStep 95: A reversible, animated source code stepper. In: J. Stasko J. Domingue M. Brown B. Price (Eds.). Software Visualization: Programming as a Multimedia Experience 1998 MIT Press Cambridge, MA 277-292
25. N. Heger A. Cypher D. Smith Cocoa at the Visual Programming Challenge 1997 Journal of Visual Languages and Computing 9 2 1998 151-168
26. J. Atwood, M. Burnett, R. Walpole, E. Wilcox, S. Yang, Steering programs via time travel, in: Proceedings of the IEEE Symposium on Visual Languages, Boulder, CO, September 3-6, 1996, pp. 4-11
27. D. Kimelman B. Rosenburg T. Roth Visualization of dynamics in real world software systems. In: J. Stasko J. Domingue M. Brown B. Price (Eds.). Software Visualization: Programming as a Multimedia Experience 1998 MIT Press Cambridge, MA 293-314
28. M. Heath A. Malony D. Rover Visualization for parallel performance evaluation and optimization. In: J. Stasko J. Domingue M. Brown B. Price (Eds.). Software Visualization: Programming as a Multimedia Experience 1998 MIT Press Cambridge, MA 347-365
29. S. Eick Maintenance of large systems. In: J. Stasko J. Domingue M. Brown B. Price (Eds.). Software Visualization: Programming as a Multimedia Experience 1998 MIT Press Cambridge, MA 315-328
30. A.J. Ko, B.A. Myers, Designing the Whyline: A debugging interface for asking questions about program failures, in: Proceedings of the ACM Conference on Human Factors in Computing Systems, Vienna, Austria, April 24-29, 2004, pp. 151-158
31. T. Igarashi, J.D. Mackinlay, B.-W. Chang, P.T. Zellweger, Fluid visualization of spreadsheet structures, in: Proceedings of the IEEE Symposium on Visual Languages, 1998, pp. 118-125
32. J. Sajaniemi Modeling spreadsheet audit: A rigorous approach to automatic visualization Journal on Visual Languages and Computing 11 1 2000 49-82
33. J.S. Davis Tools for spreadsheet auditing International Journal on Human-Computer Studies 45 1996 429-442
34. D.A. Carr, End-user programmers need improved development support, in: CHI 2003 Workshop on Perspectives in End-User Development, April 2003, pp. 16-18
35. R.C. Miller, B.A. Myers, Outlier finding: Focusing user attention on possible errors, in: Proceedings of the ACM Symposium on User Interface Software and Technology, November 2001, pp. 81-90
36. M. Burnett, C. Cook, O. Pendse, G. Rothermel, J. Summet, C. Wallace, End-user software engineering with assertions in the spreadsheet paradigm, in: Proceedings of the 25th International Conference on Software Engineering, Portland, OR, May 3-10, 2003, pp. 93-103
37. A. Wilson, M. Burnett, L. Beckwith, O. Granatir, L. Casburn, C. Cook, M. Durham, G. Rothermel, Harnessing curiosity to increase correctness in end-user programming, in: Proceedings of the ACM Conference on Human Factors in Computing Systems, Fort Lauderdale, FL, April 5-10, 2003, pp. 305-312
38. Y. Ayalew, R. Mittermeir, Spreadsheet debugging, in: Proceedings of the European Spreadsheet Risks Interest Group, Dublin, Ireland, July 24-25, 2003
39. F. Tip A survey of program slicing techniques Journal on Programming Languages 3 3 1995 121-189
40. H. Agrawal, J.R. Horgan, S. London, W.E. Wong, Fault localization using execution slices and dataflow tests, in: Proceedings of the International Symposium Software Reliability Engineering, Toulouse, France, October 1995, pp. 143-151
41. J.A. Jones, M.J. Harrold, J. Stasko, Visualization of test information to assist fault localization, in: Proceedings of the 24th International Conference on Software Engineering, Orlando, FL, May 19-25, 2002, pp. 467-477
42. H. Pan, E. Spafford, Toward automatic localization of software faults, in: Proceedings of the 10th Pacific Northwest Software Quality Conference, October 1992
43. M. Burnett, A. Sheretov, G. Rothermel, Scaling up a 'What You See Is What You Test' methodology to spreadsheet grids, in: Proceedings of the IEEE Symposium on Visual Languages, Tokyo, Japan, September 13-16, 1999, pp. 30-37
44. G. Rothermel M. Burnett L. Li C. Dupuis A. Sheretov A methodology for testing spreadsheets ACM Transactions on Software Engineering and Methodology 10 1 2001 110-147
45. G. Rothermel, L. Li, C. Dupuis, M. Burnett, What you see is what you test: A methodology for testing form-based visual programs, in: Proceedings of the 20th International Conference on Software Engineering, June 1998, pp. 198-207
46. M. Fisher, M. Cao, G. Rothermel, C.R. Cook, M.M. Burnett, Automated test case generation for spreadsheets, in: Proceedings of the 24th International Conference on Software Engineering, Orlando, FL, May 19-25, 2002, pp. 141-151
47. M. Fisher II, D. Jin, G. Rothermel, M. Burnett, Test reuse in the spreadsheet paradigm, in: Proceedings of the IEEE International Symposium on Software Reliability Engineering, November 2002
48. V. Krishna, C. Cook, D. Keller, J. Cantrell, C. Wallace, M. Burnett, G. Rothermel, Incorporating incremental validation and impact analysis into spreadsheet maintenance: An empirical study, in: Proceedings of the International Conference on Software Maintenance, Florence, Italy, November 2001, pp. 72-81
49. K.J. Rothermel, C.R. Cook, M.M. Burnett, J. Schonfeld, T.R.G. Green, G. Rothermel, WYSIWYT testing in the spreadsheet paradigm: An empirical evaluation, in: Proceedings of the 22nd International Conference on Software Engineering, Limerick, Ireland, June 4-11, 2000, pp. 230-239
50. C. Corritore, B. Kracher, S. Wiedenbeck, Trust in the online environment, in: HCI International, vol. 1, New Orleans, LA, August 2001, pp. 1548-1552
51. M. Weiser Program slicing IEEE Transactions on Software Engineering 10 4 1984 352-357
52. B. Korel J. Laski Dynamic slicing of computer programs Journal of Systems and Software 13 3 1990 187-195
53. J.R. Lyle, M. Weiser, Automatic program bug location by program slicing, in: Proceedings of the Second International Conference on Computers and Applications, 1987, pp. 877-883
54. J. Ruthruff, E. Creswick, M. Burnett, C. Cook, S. Prabhakararao, M. Fisher II, M. Main, End-user software visualizations for fault localization, in: Proceedings of the ACM Symposium on Software Visualization, San Diego, CA, June 11-13, 2003, pp. 123-132
55. J. Reichwein, M.M. Burnett, An integrated methodology for spreadsheet testing and debugging, Technical Report 04-60-02, Oregon State University, Corvallis, OR, January 2004, http://eecs.oregonstate.edu/library/?call=2004-6, Last Accessed: July 19th, 2004
56. S. Prabhakararao, C.R. Cook, Interactive fault localization for end-user programmers: A think aloud study, Technical Report 04-60-03, Oregon State University, Corvallis, OR, January 2004, http://eecs.oregonstate.edu/library/call=2004-39, Last Accessed: July 19th, 2004
57. C. Allwood Error detection processes in statistical problem solving Cognitive Science 8 4 1984 413-437
58. A. Blackwell, First steps in programming: A rationale for attention investment models, in: Proceedings of the IEEE Symposium on Human-Centric Computing Languages and Environments, Arlington, VA, September 3-6, 2002, pp. 2-10
59. C. Nass Y. Moon P. Carney Are people polite to computers? Responses to computer-based interviewing systems Journal of Applied Social Psychology 29 5 1999 1093-1110
60. L. Beckwith, M. Burnett, C. Cook, Reasoning about many-to-many requirement relationships in spreadsheets, in: Proceedings of the IEEE Symposium on Human-Centric Computing Languages and Environments, Arlington, VA, September 3-6, 2002, pp. 149-157
61. J.R. Ruthruff, M. Burnett, G. Rothermel, The impact of two orthogonal factors in interactive fault localization, Technical Report 04-60-08, Oregon State University, Corvallis, OR, June 2004, http://eecs.oregonstate.edu/library/call=2004-37, Last Accessed: July 19th, 2004.
62. L.M. Leventhal B.E. Teasley D.S. Rohlman Analyses of factors related to positive test bias in software testing International Journal of Human-Computer Studies 41 2004 717-749
63. C. Wohlin P. Runeson M. Host B. Regnell A. Wesslen Experimentation in Software Engineering 2000 Kluwer Academic Publishers Boston, MA
64. P.T. Cox, F.R. Giles, T. Pietrzykowski, Prograph: A step towards liberating programming from textual conditioning, in: IEEE Workshop on Visual Languages, Rome, Italy, October 4-6, 1989, pp. 150-156
65. M. Karam, T. Smedley, A testing methodology for a dataflow based visual programming language, in: Proceedings of the IEEE Symposium on Human-Centric Computing Languages and Environments, Stresa, Italy, September 5-7, 2001, pp. 280-287
66. D. Brown, M. Burnett, G. Rothermel, H. Fujita, F. Negoro, Generalizing WYSIWYT visual testing to screen transition languages, in: Proceedings of the IEEE Symposium on Human-Centric Computing Languages and Environments, Auckland, New Zealand, October 28-31, 2003, pp. 203-210