Explanatory debugging: Supporting end-user debugging of machine-learned programs

Proceedings - 2010 IEEE Symposium on Visual Languages and Human-Centric Computing, VL/HCC 2010

Volumn , Issue , 2010, Pages 41-48

  Kulesza, Todd ^a   Stumpf, Simone ^b   Burnett, Margaret ^a   Wong, Weng Keen ^a   Riche, Yann ^c   Moore, Travis ^a   Oberst, Ian ^a   Shinsel, Amber ^a   McIntosh, Kevin ^a  

^a OREGON STATE UNIVERSITY   (United States)

^b CITY UNIVERSITY   (United Kingdom)

^c Rirche Design ^*  (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CONCEPT-BASED; END USERS; LITTLE RESEARCH; MACHINE LEARNING ALGORITHMS; NATURAL PROGRAMMING;

CHARACTER RECOGNITION; LEARNING ALGORITHMS; TEXT PROCESSING;

PROGRAM DEBUGGING;

EID: 79952058880     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/VLHCC.2010.15     Document Type: Conference Paper

References (24)

1. Becker, B., Kohavi, R., and Sommerfield, D. Visualizing the simple Bayesian classifier. In Fayyad, U, Grinstein, G. and Wierse A. (Eds.) Information Visualisation in Data Mining and Knowledge Discovery, (2001), 237-249.
2. Billsus, D., Hilbert, D. and Maynes-Aminzade, D. Improving proactive information systems. Proc. IUI, ACM (2005), 159-166.
3. Chen, J. and Weld, D. Recovering from errors during programming by demonstration. Proc. IUI, ACM (2008), 159-168.
4. Culotta, A., Kristiansson, T., McCallum, A. and Viola, P. Corrective feedback and persistent learning for information extraction. Artificial Intelligence 170 (2006), 1101-1122. (Pubitemid 44573089)
5. Dönmez, P., Rosé, C., Stegmann, K., Weinberger, A. and Fischer, F. Supporting CSCL with automatic corpus analysis technology. Proc. CSCL, ACM (2005), 125-134.
6. Glass, A., McGuinness, D. and Wolverton, M. Toward establishing trust in adaptive agents. Proc. IUI, ACM (2008), 227-236.
7. Hart, S. and Staveland, L. Development of a NASA-TLX (Task load index): Results of empirical and theoretical research, Hancock, P. and Meshkati, N. (Eds.), Human Mental Workload, (1988), 139-183.
8. Herlocker, J., Konstan, J. and Riedl, J. Explaining collaborative filtering recommendations. Proc. CSCW, ACM (2000), 241-250.
9. Ko, A. and Myers, B. Designing the Whyline: A debugging interface for asking questions about program failures. Proc. CHI, ACM (2004), 151-158.
10. Konold, C. Informal conceptions of probability. Cognition and Instruction 6(1) (1989), 59-98.
11. Kononenko, I. Inductive and bayesian learning in medical diagnosis. Applied Artificial Intelligence 7, (1993), 317-337.
12. Kulesza, T., Wong, W.-K., Stumpf, S., Perona, S., White, S., Burnett M., Oberst, I. and Ko, A. Fixing the program my computer learned: Barriers for end users, challenges for the machine. Proc. IUI, ACM (2009), 187-196.
13. Lacave, C., and Diez, F. A review of explanation methods for Bayesian networks. Knowledge Engineering Review 17, 2, Cambridge University Press, (2002), 107-127.
14. Lim, B. Y., Dey, A. K., and Avrahami, D. 2009. Why and why not explanations improve the intelligibility of context-aware intelligent systems Proc. CHI, ACM (2009), 2119-2128.
15. Maulsby, D., and Witten, I. Cima: an interactive concept learning system for end-user applications. Applied Artificial Intelligence 11, (1997), 653-671.
16. Obsert, I., Moore, T., Wong, W.-K., Kulesza, T., Stumpf, S., Riche, Y., Burnett, M. End-user feature engineering in the presence of class imbalance (Technical Report). Oregon State University, School of EECS (2009). http://hdl.handle.net/1957/13225.
17. Pane, J., Myers, B. More natural programming languages and environments, In H. Lieberman, F. Paterno, V. Wulf (Eds.) End User Development, Springer (2006), 31-50.
18. Poulin, B., Eisner, R., Szafron, D., Lu, P., Greiner, R., Wishart, D. S., Fyshe, A., Pearcy, B., MacDonnell, C., and Anvik, J. Visual explanation of evidence in additive classifiers. Proc. IAAI, (2006).
19. Stumpf, S., Rajaram, V., Li, L., Burnett, M., Dietterich, T., Sullivan, E., Drummond, R. and Herlocker, J. Toward harnessing user feedback for machine learning. Proc. IUI, ACM (2007), 82-91.
20. Stumpf, S., Sullivan, E., Fitzhenry, E., Oberst, I., Wong, W.-K. and Burnett, M. Integrating rich user feedback into intelligent user interfaces. Proc. IUI, ACM (2008), 50-59.
21. Subrahmaniyan, N., Beckwith, L., Grigoreanu, V., Burnett, M., Wiedenbeck, S., Narayanan, V., Bucht, K., Drummond, R., and Fern, X. Testing vs. code inspection vs. what else?: male and female end users' debugging strategies. Proc. CHI, ACM (2008), 617-626.
22. Talbot, J., Lee, B., Kapoor, A., and Tan, D. S. 2009. EnsembleMatrix: interactive visualization to support machine learning with multiple classifiers. Proc. CHI, ACM (2009). 1283-1292.
23. Tullio, J., Dey, A., Chalecki, J. and Fogarty, J. How it works: a field study of non-technical users interacting with an intelligent system. Proc. CHI, ACM (2007), 31-40.
24. Vig, J., Sen, S., and Riedl, J. Tagsplanations: explaining recommendations using tags. Proc. IUI, ACM (2009), 47-56.