EnsembleMatrix: Interactive visualization to support machine learning with multiple classifiers

Conference on Human Factors in Computing Systems - Proceedings

Volumn , Issue , 2009, Pages 1283-1292

  Talbot, Justin ^a,b   Lee, Bongshin ^b   Kapoor, Ashish ^b   Tan, Desney S ^b  

^a STANFORD UNIVERSITY   (United States)

^b MICROSOFT RESEARCH   (United States)

Author keywords

Caltech 101; Ensemble classifiers; Interactive machine learning; Object recognition; Visualization

Indexed keywords

CALTECH-101; ENSEMBLE CLASSIFICATION; ENSEMBLE CLASSIFIERS; HUMAN-COMPUTER INTERACTION RESEARCHES; INTERACTIVE MACHINE LEARNING; INTERACTIVE VISUALIZATION SYSTEMS; INTERACTIVE VISUALIZATIONS; MULTIPLE CLASSIFIERS;

FLOW VISUALIZATION; HUMAN COMPUTER INTERACTION; HUMAN ENGINEERING; ITERATIVE METHODS; LEARNING ALGORITHMS; LEARNING SYSTEMS; VISUALIZATION;

OBJECT RECOGNITION;

EID: 84879707297     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1518701.1518895     Document Type: Conference Paper

References (37)

1. Ankerst, M., Elsen, C., Ester, M. and Kriegel, H.-P. Visual classification: an interactive approach to decision tree construction. Proc. KDD 1999, (1999), 392-396.
2. Becker, B., Kohavi, R. and Sommerfield, D. Visualizing the Simple Bayesian Classifier, [ed.] Fayyad, U., Grins- tein, G. and Wierse. A. (2001), 237-249.
3. Bertin, J. Semiology of graphics. University of Wisconsin Press, Madison, WI, USA, 1984.
4. Bosch, A., Zisserman, A. and Munoz, X. Representing shape with a spatial pvramid kernel. Proc. CIl'R 2007, (2007), 401-408.
5. Breiman, L. Bagging predictors. Machine Learning, (1996), 123-140.
6. Caragea, D., Cook, D. and Honavar, V.G. Gaining insights into support vector machine pattern classifiers using projection-based tour methods. Proc. KDD 2001, (2001), 251-256.
7. Dai, J. and Cheng, J. HMMEditor: A visual editing tool for profile hidden Markov models. PMC Genomics 2008, 9 (2008).
8. Drummond, C. and Holte, R.C. Cost curves: An improved method for visualizing classifier performance. Machine Learning, 65, 1 (2006), 95-130.
9. Evgeniou, T., Pontil, M. and Elisseef, T A. Leave One Out Error, Stability, and Generalization of Voting Combinations of Classifiers. Machine Learning, 55 (2004), 71-97.
10. Fails, J.A. and Olsen, D.R.J. Interactive machine learning. Proc. I UI2003, (2003), 39-45.
11. Fei-Fei, L., Fergus, R. and Perona, P. Learning Generative Visual Models from Few Training Examples: An Incremental Bayesian Approach Tested on 101 Object Categories. CVPRW, 12 (2004), 178.
12. Fogarty, J., Ko, A.J., Aung, H.H., Golden, E., Tang, K.P. and Hudson, S.E. Examining task engagement in sensor-based statistical models of human interruptibility. Proc. CHI 2005. (2005), 331 -340.
13. Frank, E. and Hall, M. Visualizing class probability estimators. Lecture Notes in Artificial Intelligence 2838, Springer (2003), 168-179.
14. Garner, S.R. WEKA: The Waikato Environment for Knowledge Analysis. Proc. New Zealand Computer Science Research Students Conference (1995), 57-64.
15. Grauman, K. and Darrell, T. The Pyramid Match Kernel: Discriminative Classification with Sets of Image Features. Proc. ICCV' 2005. (2005). 1458-1465.
16. Grimes, D., Tan, D.S., Hudson, S.E., Shenoy, P. and Rao, R.P. Feasibility and pragmatics of classifying working memory load with an electroencephaloraph. Proc. CHI 2008. (2008). 835-844.
17. Henry, N. and Fekete, J.-D. MatrixExplorer: A Dual- Representation System to Explore Social Networks. IEEE Trans Visualization and Computer Graphics, 12, (2006). 677-684.
18. Kapoor, A., Grauman, K., Urtasun, R. and Darrell, T. Active Learning with Gaussian Processes for Object Categorization. Proc. ICCV 2007, (2007), 1-8.
19. Kapoor, A. and Horvitz, E. Experience sampling for building predictive user models: A comparative study. Proc. CHI 2008, (2008), 657-666.
20. Kim, B., Lee, B. and Seo, J. Visualizing set concordance with permutation matrices and fan diagrams. Interacting with Computers, 19, 5-6 (2007), 630-643.
21. Kittler, J., Hatef, M., Duin, R.P. and Matas, J. On Combining Classifiers. IEEE TP AMI, 20, 3 (1998), 226-239.
22. Lazebnik, S., Schmid, C. and Ponce, J. Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories. Proc. CVPR 2006, (2006), 2169-2178.
23. Makinen, E. and Siirtola, H. The Barycenter Heuristic and the Reorderable Matrix. Informatica (Slovenia), 29, 3 (2005), 357-364.
24. Meyer, M., Lee, H., Barr, A. and Desbrun, M. Generalized Barycentric Coordinates on Irregular Polygons. Journal of Graphics Tools, 1, 1 (2002), 13-22.
25. Moustakis, V. Do People in HCI Use Machine Learning? HCI, 2, (1997), 95-98.
26. Oliver, N., Garg, A. and Horvitz, E. Layered representations for learning and inferring office activity from multiple sensory channels. Computer Vision and Image Understanding, 96, 2 (2004) 163-180.
27. Patel, K., Fogarty, J., Landay, J.A. and Harrison, B. Examining Difficulties Software Developers Encounter in the Adoption of Statistical Machine Learning. Proc. AAAI 2008, (2008), 1563-1566.
28. Picard, R.W. Affective computing. MIT Press, Cambridge, MA, USA, 1997.
29. Rheingans, P. and desJardins, M. Visualizing High- Dimensional Predictive Model Quality. Proc. VIS 2000, 493-496.
30. Saponas, T.S., Tan, D.S., Morris, D. and Balakrishnan, R. Demonstrating the feasibility of using forearm electromyography for muscle-computer interfaces. Proc. CHI 2008, (2008), 515-524.
31. Schapire, R.E. The boosting approach to machine learning: An overview. Nonlinear Estimation and Classification. Springer (2003).
32. Stiglic, G., Mertik, M., Podgorelec, V. and Kokol, P. Using Visual Interpretation of Small Ensembles in Mi- croarray Analysis. Proc. CMBS 2006, (2006), 691-695.
33. Urbanek, S. Exploring Statistical Forests. Proc. of the 2002 Joint Statistical Meeting, Springer (2002).
34. Varma, M. and Ray, D. Learning The Discriminative Power-lnvariance Trade-Off. Proc. ICCV 2007, (2007), 1-8.
35. Wang, J., Yu, B. and Gasser, L. Classification Visualization with Shaded Similarity Matrix, Technical Report, GSLIS University of Illinois at Urbana-Champaign, (2002).
36. Ware, M., Frank, E., Holmes, G., Hall, M. and Witten, l.H. Interactive machine learning: letting users build classifiers. Int. J. Human-Computer Studies, 55, 3, 281-292.
37. Zhang, H., Berg, A. C., Maire, M. and Malik, J. SVM- KNN: Discriminative Nearest Neighbor Classification for Visual Category Recognition. Proc. CVPR 2006, (2006), 2126-2136.