FeatureInsight: Visual support for error-driven feature ideation in text classification

2015 IEEE Conference on Visual Analytics Science and Technology, VAST 2015 - Proceedings

Volumn , Issue , 2015, Pages 105-112

  Brooks, Michael ^a   Amershi, Saleema ^b   Lee, Bongshin ^b   Drucker, Steven M ^b   Kapoor, Ashish ^b   Simard, Patrice ^b  

^a UNIVERSITY OF WASHINGTON   (United States)

^b MICROSOFT RESEARCH   (United States)

Author keywords

dictionaries; Features; interactive machine learning; machine learning; text classification; visualization

Indexed keywords

ALGORITHMS; ARTIFICIAL INTELLIGENCE; ERRORS; FLOW VISUALIZATION; GLOSSARIES; GRAPHICAL USER INTERFACES; LEARNING ALGORITHMS; LEARNING SYSTEMS; TEXT PROCESSING; VISUALIZATION;

CONTROLLED EXPERIMENT; DATA TYPE; FEATURES; INTERACTIVE MACHINE LEARNING; TEXT CLASSIFICATION; VISUAL ANALYTICS;

CLASSIFICATION (OF INFORMATION);

EID: 84962788659     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/VAST.2015.7347637     Document Type: Conference Paper

References (37)

1. P. Domingos, "A few useful things to know about machine learning," Commun. ACM, vol. 55, no. 10, pp. 78-87, 2012.
2. Y. Yang and J. Pedersen, "A comparative study on feature selection in text categorization," presented at the Proceedings of ICML-97, 14th International Conference on Machine Learning, 1997, pp. 412-420.
3. M. Anderson, D. Antenucci, V. Bittorf, M. Burgess, M. J. Cafarella, A. Kumar, F. Niu, Y. Park, C. Ré, and C. Zhang, "Brainwash: A Data System for Feature Engineering.," in Proc. CIDR 2013, 2013.
4. A. L. Blum and P. Langley, "Selection of relevant features and examples in machine learning," Artif. Intell., vol. 97, no. 1, pp. 245-271, 1997.
5. S. Bird, E. Klein, and E. Loper, Natural Language Processing with Python. O'Reilly Media, Inc., 2009.
6. E. Mayfield and C. P. Rosé, "Light SIDE: Text Mining and Machine Learning User's Manual." 2012.
7. K. Patel, J. Fogarty, J. A. Landay, and B. Harrison, "Investigating Statistical Machine Learning As a Tool for Software Development," in Proc. CHI 2008, New York, NY, USA, 2008.
8. J. Fogarty and S. E. Hudson, "Toolkit Support for Developing and Deploying Sensor-based Statistical Models of Human Situations," in Proc. CHI 2007, New York, NY, USA, 2007.
9. S. Markovitch and D. Rosenstein, "Feature Generation Using General Constructor Functions," Mach. Learn., vol. 49, no. 1, pp. 59-98, Oct. 2002.
10. B. Schuller, S. Reiter, and G. Rigoll, "Evolutionary Feature Generation in Speech Emotion Recognition," in Proc. 2006 Intl. Conf. on Multimedia and Expo, 2006.
11. Y. Aphinyanaphongs, L. D. Fu, Z. Li, E. R. Peskin, E. Efstathiadis, C. F. Aliferis, and A. Statnikov, "A comprehensive empirical comparison of modern supervised classification and feature selection methods for text categorization," J. Assoc. Inf. Sci. Technol., vol. 65, no. 10, pp. 1964-1987, 2014.
12. G. Forman, "An Extensive Empirical Study of Feature Selection Metrics for Text Classification," J Mach Learn Res, vol. 3, pp. 1289-1305, Mar. 2003.
13. S. Stumpf, V. Rajaram, L. Li, W.-K. Wong, M. Burnett, T. Dietterich, E. Sullivan, and J. Herlocker, "Interacting meaningfully with machine learning systems: Three experiments," IJHCI, vol. 67, no. 8, pp. 639-662, Aug. 2009.
14. C. Rosé, Y.-C. Wang, Y. Cui, J. Arguello, K. Stegmann, A. Weinberger, and F. Fischer, "Analyzing collaborative learning processes automatically: Exploiting the advances of computational linguistics in computer-supported collaborative learning," Comput.- Support. Collab. Learn., vol. 3, no. 3, pp. 237-271, Jan. 2008.
15. H. Raghavan, O. Madani, and R. Jones, "Inter Active Feature Selection," in Proc. IJCAI 2005, 2005, vol. 5.
16. J. Cheng and M. S. Bernstein, "Flock: Hybrid Crowd-Machine Learning Classifiers," 2015, pp. 600-611.
17. K. Patel, S. M. Drucker, J. Fogarty, A. Kapoor, and D. S. Tan, "Using multiple models to understand data," in Proc. IJCAI 2011, 2011.
18. S. Stumpf, V. Rajaram, L. Li, M. Burnett, T. Dietterich, E. Sullivan, R. Drummond, and J. Herlocker, "Toward harnessing user feedback for machine learning," in Proc. IUI 2007, 2007.
19. J. G. S. Paiva, W. R. Schwartz, H. Pedrini, and R. Minghim, "An Approach to Supporting Incremental Visual Data Classification," IEEE Trans. Vis. Comput. Graph., vol. 21, no. 1, pp. 4-17, Jan. 2015.
20. J. Choo, H. Lee, J. Kihm, and H. Park, "iVisClassifier: An interactive visual analytics system for classification based on supervised dimension reduction," in 2010 IEEE Symposium on Visual Analytics Science and Technology (VAST), 2010, pp. 27-34.
21. T. Kulesza, W.-K. Wong, S. Stumpf, S. Perona, R. White, M. M. Burnett, I. Oberst, and A. J. Ko, "Fixing the Program My Computer Learned: Barriers for End Users, Challenges for the Machine," in Proc. IUI 2009, New York, NY, USA, 2009.
22. F. Heimerl, C. Jochim, S. Koch, and T. Ertl, "Feature Forge: A Novel Tool for Visually Supported Feature Engineering and Corpus Revision," in Proceedings of COLING 2012: Posters, Mumbai, India, 2012, pp. 461-470.
23. F. Sebastiani, "Machine Learning in Automated Text Categorization," ACM Comput. Surv., vol. 34, no. 1, Mar. 2002.
24. T. Joachims, "Text categorization with support vector machines: Learning with many relevant features," in Proc. ECML 1998, 1998.
25. S. Scott and S. Matwin, "Feature engineering for text classification," in Proc. ICML 1999, 1999, vol. 99, pp. 379-388.
26. P. J. Stone and E. B. Hunt, "A Computer Approach to Content Analysis: Studies Using the General Inquirer System," in Proc. 1963 Joint Computer Conference, New York, NY, USA, 1963.
27. R. Collobert, J. Weston, L. Bottou, M. Karlen, K. Kavukcuoglu, and P. Kuksa, "Natural Language Processing (Almost) from Scratch," JMLR, vol. 12, pp. 2493-2537, Nov. 2011.
28. A. Smith and M. Osborne, "Using Gazetteers in Discriminative Information Extraction," in Proc. Conf. on Comp. Natural Language Learning 2006, Stroudsburg, PA, USA, 2006.
29. M. Taboada, J. Brooke, M. Tofiloski, K. Voll, and M. Stede, "Lexicon-Based Methods for Sentiment Analysis," Comput. Linguist., vol. 37, no. 2, pp. 267-307, Apr. 2011.
30. G. Salton and C. Buckley, "Term-weighting approaches in automatic text retrieval," Inf. Process. Manag., vol. 24, no. 5, pp. 513-523, 1988.
31. J. Chuang, C. D. Manning, and J. Heer, "Termite: Visualization Techniques for Assessing Textual Topic Models," in Proc. AVI 2012, New York, NY, USA, 2012.
32. F. B. Viégas and M. Wattenberg, "TIMELINES: Tag Clouds and the Case for Vernacular Visualization," interactions, vol. 15, no. 4, pp. 49-52, Jul. 2008.
33. G. Coppersmith and E. Kelly, "Dynamic Wordclouds and Vennclouds for Exploratory Data Analysis," in Proc. 2014 ACL Workshop on Interactive Language Learning, Visualization, and Interfaces, 2014.
34. E. Williams, "Experimental Designs Balanced for the Estimation of Residual Effects of Treatments," Aust. J. Chem., vol. 2, no. 2, pp. 149-168, Jan. 1949.
35. J. Davis and M. Goadrich, "The relationship between Precision-Recall and ROC curves," in Proc. ICML 2006, 2006.
36. R. D. Wolfinger, R. D. Tobias, and J. Sall, "Mixed models: a future direction," in SAS Users Group Conf., 1991, pp. 1380-1388.
37. F. Pedregosa, G. Varoquaux, A. Gramfort, V. Michel, B. Thirion, O. Grisel, M. Blondel, P. Prettenhofer, R. Weiss, V. Dubourg, J. Vanderplas, A. Passos, D. Cournapeau, M. Brucher, M. Perrot, and E. Duchesnay, "Scikit-learn: Machine Learning in Python," J. Mach. Learn. Res., vol. 12, pp. 2825-2830, 2011.