Interactive optimization for steering machine classification

Conference on Human Factors in Computing Systems - Proceedings

Volumn 2, Issue , 2010, Pages 1343-1352

  Kapoor, Ashish ^a   Lee, Bongshin ^a   Tan, Desney ^a   Horvitz, Eric ^a  

^a MICROSOFT RESEARCH   (United States)

Author keywords

decision theory; interactive machine learning; interactive optimization; visualization

Indexed keywords

APPLICATION REQUIREMENTS; BLACK BOXES; CLASSIFICATION SYSTEM; CONFUSION MATRICES; CORE METHOD; DECISION BOUNDARY; HIDDEN STATE; INTERACTIVE OPTIMIZATION; MACHINE-LEARNING; PERFORMANCE OF CLASSIFIER; STATISTICAL CLASSIFIER; SYSTEM BUILDERS; USER INTENTION; USER STUDY;

CLASSIFIERS; GAME THEORY; HUMAN COMPUTER INTERACTION; HUMAN ENGINEERING; LEARNING SYSTEMS; OPTIMIZATION; REFINING; VISUALIZATION;

DECISION THEORY;

EID: 77953996903     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1753326.1753529     Document Type: Conference Paper

References (27)

1. 20 Newsgroups. http://kdd.ics.uci.edu/databases/20newsgroups/ 20newsgroups.html.
2. Ankerst, M., Elsen, C., Ester, M. and Kriegel, H.-P. Visual classification: an interactive approach to decision tree construction. KDD 1999.
3. Becker, B., Kohavi, R. and Sommerfield, D. Visualizing the Simple Bayesian Classifier. Information Visualization in Data Mining and Knowledge Discovery, [ed.] Fayyad, U., Grinstein, G. and Wierse, A. (2001).
4. Caragea, D., Cook, D. and Honavar, V.G. Gaining insights into support vector machine pattern classifiers using projection-based tour methods. KDD 2001.
5. Cover, T.M. and Thomas, A.J. Elements of Information Theory. Wiley-Interscience, Hoboken, NJ, USA, 2006.
6. Dai, J. and Cheng, J. HMM Editor: a visual editing tool for profile hidden Markov models. BMC Genomics 9, Suppl1 (2008).
7. Drummond, C. and Holte, R.C. Cost curves: An improved method for visualizing classifier performance. Machine Learning 65, 1 (2006).
8. Duda, R.O, Hart, P.E. and Stock, D.G. Pattern Classification. Wiley-Interscience, Hoboken, NJ, USA, 2004.
9. Evgeniou, T., Pontil, M. and Elisseeff, A. Leave One Out Error, Stability, and Generalization of Voting Combinations of Classifiers. Machine Learning 55, 1 (2004).
10. Fails, J.A. and Olsen, D.R.J. Interactive machine learning. IUI 2003.
11. Fei-Fei, L., Fergus, R. and Perona, P. One-Shot Learning of Object Categories. IEEE Transactions on Pattern Analysis and Machine Intelligence 28, 4 (2006).
12. Fogarty, J., Ko, A., Aung, H., Golden, E., Tang, K. and Hudson, S. Examining task engagement in sensor-based statistical models of human interruptibility. CHI 2005.
13. Frank, E. and Hall, M. Visualizing class probability estimators. LNCS 2838, Springer (2003).
14. Garner, S.R. WEKA: The Waikato Environment for Knowledge Analysis. New Zealand Computer Science Research Students Conference, (1995).
15. Grimes, D., Tan, D., Hudson, S., Shenoy, P. and Rao, R. Feasibility and pragmatics of classifying working memory load with an electroencephalograph. CHI 2008.
16. Horvitz, E. and Apacible, J. Learning and Reasoning about Interruption. ICMI 2003.
17. Kapoor, A. and Horvitz, E. Experience sampling for building predictive user models: a comparative study. CHI 2008.
18. Moustakis, V. Do People in HCI Use Machine Learning? HCI 2, (1997).
19. Patel, K., Fogarty, J., Landay, J. and Harrison, B. Examining Difficulties Software Developers Encounter in the Adoption of Statistical Machine Learning. AAAI 2008.
20. Picard, R.W. Affective computing. MIT Press, Cambridge, MA, USA, 1997.
21. Platt, J.C. Probabilistic Outputs for Support Vector Machines and Comparisons to Regularized Likelihood Methods. Advances in Large Margin Classifiers, MIT Press (1999).
22. Rheingans, P. and desJardins, M. Visualizing High-Dimensional Predictive Model Quality. VIS 2000.
23. Saponas, S., Tan, S., Morris, D. and Balakrishnan, R. Demonstrating the feasibility of using forearm electromyography for muscle-computer interfaces. CHI 2008.
24. Stiglic, G., Mertik, M., Podgorelec, V. and Kokol, P. Using Visual Interpretation of Small Ensembles in Microarray Analysis. CMBS 2006.
25. Talbot, J., Lee, B., Kapoor, A., and Tan, D. Ensemble Matrix: Interactive Visualization to Support Machine Learning with Multiple Classifiers, CHI 2009.
26. Urbanek, S. Exploring Statistical Forests. Joint Statistical Meeting 2002.
27. Ware, M., Frank, E., Holmes, G., Hall, M. and Witten, I. Interactive machine learning: letting users build classifiers. Int. J .Human-Computer Studies 56, 3 (2001).