Interpreting black-box classifiers using instance-level visual explanations

Proceedings of the 2nd Workshop on Human-In-the-Loop Data Analytics, HILDA 2017

Volumn , Issue , 2017, Pages

  Tamagnini, Paolo ^a   Krause, Josua ^b   Dasgupta, Aritra ^c   Bertini, Enrico ^b  

^a SAPIENZA UNIVERSITY OF ROME   (Italy)

^b POLYTECHNIC UNIVERSITY   (United States)

^c PACIFIC NORTHWEST NATIONAL LABORATORY   (United States)

Author keywords

Classification; Explanation; Machine learning; Visual analytics

Indexed keywords

ARTIFICIAL INTELLIGENCE; BINS; CLASSIFICATION (OF INFORMATION); DECISION TREES; FORECASTING; LEARNING SYSTEMS; VISUALIZATION;

BINARY CLASSIFIERS; EXPLANATION; HIGH-DIMENSIONAL; HUMAN-IN-THE-LOOP; MACHINE LEARNING MODELS; RANDOM FOREST MODELING; REAL WORLD DOMAIN; VISUAL ANALYTICS;

EDUCATION;

EID: 85021682673     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/3077257.3077260     Document Type: Conference Paper

References (24)

1. Saleema Amershi, Max Chickering, Steven M. Drucker, Bongshin Lee, Patrice Simard, and Jina Suh. 2015. ModelTracker: Redesigning Performance Analysis Tools for Machine Learning. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, 337-346.
2. Saleema Amershi, James Fogarty, Ashish Kapoor, and Desney Tan. 2011. Effective End-user Interaction with Machine Learning. In Proceedings of the Twenty-Fifth AAAI Conference on Artificial Intelligence (AAAI'11). AAAI Press, 1529-1532.
3. Saleema Amershi, James Fogarty, and Daniel Weld. 2012. Regroup: Interactive Machine Learning for On-demand Group Creation in Social Networks. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, 21-30.
4. Bart Baesens, Rudy Setiono, Christophe Mues, and Jan Vanthienen. 2003. Using Neural Network Rule Extraction and Decision Tables for Credit-Risk Evaluation. Manage. Sci. 49, 3 (March 2003), 312-329.
5. Leo Breiman. 2001. Random Forests. Mach. Learn. 45, 1 (Oct. 2001), 5-32.
6. Rich Caruana, Yin Lou, Johannes Gehrke, Paul Koch, Marc Sturm, and Noemie Elhadad. 2015. Intelligible Models for HealthCare: Predicting Pneumonia Risk and Hospital 30-day Readmission. In Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD '15). ACM, 1721-1730.
7. Mark W. Craven and Jude W. Shavlik. 1998. Using Neural Networks for Data Mining. (1998).
8. Alex A Freitas. 2014. Comprehensible classification models: a position paper. ACM SIGKDD explorations newsletter 15, 1 (2014), 1-10.
9. David Gunning. 2017. Explainable Artificial Intelligence (XAI). http://www.darpa.mil/program/explainable-artificial-intelligence. (2017). [Online; accessed 2017-April-7].
10. Minsuk Kahng, Dezhi Fang, and Duen Horng (Polo) Chau. 2016. Visual Exploration of Machine Learning Results Using Data Cube Analysis. In Proceedings of the Workshop on Human-In-the-Loop Data Analytics (HILDA '16). ACM.
11. Josua Krause, Adam Perer, and Enrico Bertini. 2014. INFUSE: Interactive Feature Selection for Predictive Modeling of High Dimensional Data. IEEE Transactions on Visualization and Computer Graphics 20, 12 (Dec 2014), 1614-1623.
12. Josua Krause, Adam Perer, and Enrico Bertini. 2016. Using Visual Analytics to Interpret Predictive Machine Learning Models. ArXiv e-prints 1 (June 2016). arXiv:1606.05685
13. Josua Krause, Adam Perer, and Kenney Ng. 2016. Interacting with Predictions: Visual Inspection of Black-box Machine Learning Models. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, 5686-5697.
14. Mengchen Liu, Jiaxin Shi, Zhen Li, Chongxuan Li, Jun Zhu, and Shixia Liu. 2017. Towards Better Analysis of Deep Convolutional Neural Networks. IEEE Transactions on Visualization and Computer Graphics 23, 1 (2017), 91-100.
15. Yin Lou, Rich Caruana, and Johannes Gehrke. 2012. Intelligible Models for Classification and Regression. In Proceedings of the 18th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD '12). ACM, 150-158.
16. David Martens, Bart Baesens, Tony Van Gestel, and Jan Vanthienen. 2007. Comprehensible credit scoring models using rule extraction from support vector machines. European Journal of Operational Research 183, 3 (2007), 1466 - 1476.
17. David Martens and Foster Provost. 2014. Explaining Data-driven Document Classifications. MIS Q. 38, 1 (March 2014), 73-100.
18. Jose Gustavo S Paiva, Sao Carlos, and Rosane Minghim. 2015. An approach to supporting incremental visual data classification. IEEE Transactions on Visualization and Computer Graphics 21, 1 (Jan. 2015), 4-17.
19. Paulo E. Rauber, Samuel G. Fadel, Alexandre X. Falcao, and Alexandru C. Telea. 2017. Visualizing the Hidden Activity of Artificial Neural Networks. IEEE Transactions on Visualization and Computer Graphics 23, 1 (Jan. 2017), 101-110.
20. Marco Tulio Ribeiro, Sameer Singh, and Carlos Guestrin. 2016. Why Should I Trust You?: Explaining the Predictions of Any Classifier. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 1135-1144.
21. Gary K. L. Tam, Vivek Kothari, and Min Chen. 2017. An Analysis of Machineand Human-Analytics in Classification. IEEE Trans. Vis. Comput. Graph. 23, 1 (2017), 71-80.
22. Stef van den Elzen and Jarke J. van Wijk. 2011. BaobabView: Interactive construction and analysis of decision trees. In Visual Analytics Science and Technology (VAST), IEEE Conference on. IEEE Computer Society, 151-160.
23. Laurens van der Maaten and Geoffrey E. Hinton. 2008. Visualizing High-Dimensional Data Using t-SNE. Journal of Machine Learning Research 9 (2008), 2579-2605.
24. Alfredo Vellido, Joséd. Martín-guerrero, and Paulo J. G. Lisboa. 2012. Making machine learning models interpretable. In In Proc. European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning, Vol. 12. 163-172.